-- Logs begin at Wed 2022-07-27 15:49:16 UTC, end at Wed 2022-07-27 16:55:42 UTC. -- Jul 27 16:27:01.189262 dv-cinder-849690-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 16:27:01.198355 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 16:27:01 2022] *** Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: nodename: dv-cinder-849690-6-iscsi Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: machine: x86_64 Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: clock source: unix Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: pcre jit disabled Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: detected number of CPU cores: 4 Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: current working directory: / Jul 27 16:27:01.200308 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: detected binary path: /usr/bin/uwsgi-core Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: your processes number limit is 47680 Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: your memory page size is 4096 bytes Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: detected max file descriptor number: 2048 Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: lock engine: pthread robust mutexes Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: thunder lock: enabled Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 16:27:01.201020 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 16:27:01.239506 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: Python main interpreter initialized at 0x55bb7f97a9c0 Jul 27 16:27:01.239506 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: python threads support enabled Jul 27 16:27:01.239506 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: your server socket listen backlog is limited to 100 connections Jul 27 16:27:01.239506 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: your mercy for graceful operations on workers is 90 seconds Jul 27 16:27:01.239834 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 16:27:01.239909 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: *** Operational MODE: preforking *** Jul 27 16:27:01.240150 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: *** uWSGI is running in multiple interpreter mode *** Jul 27 16:27:01.240150 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: spawned uWSGI master process (pid: 103270) Jul 27 16:27:01.240323 dv-cinder-849690-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 16:27:01.244931 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 1 (pid: 103271, cores: 1) Jul 27 16:27:01.244931 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 2 (pid: 103272, cores: 1) Jul 27 16:27:01.244931 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 16:27:01.901321 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 16:27:01.913455 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 16:27:02.977682 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:27:02.977682 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 27 16:27:02.978271 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:27:02.978271 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 27 16:27:02.982225 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:27:02.982225 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 27 16:27:02.982668 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:27:02.982668 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 27 16:27:05.474746 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:27:05.475297 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:27:05.475455 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:27:05.475867 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:27:05.475957 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:27:05.476039 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:27:05.476302 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:27:05.476463 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:27:05.476807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.476927 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:27:05.477095 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:27:05.477199 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.477574 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.477693 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.477898 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.477987 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.478225 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.478312 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.478540 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.478626 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.478865 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.478959 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.479181 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.479290 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.479505 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.479596 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.479763 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.479856 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.480080 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.480181 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.480397 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.480488 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-6-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.480719 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.480810 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481049 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481149 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-6-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481364 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481450 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481683 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481774 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.481988 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.482089 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.482310 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.482402 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.482617 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.482713 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.482947 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.483110 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.483255 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.483564 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.483770 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.483889 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.484091 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.484192 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.484401 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.484502 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.484713 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.484819 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.485078 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.485176 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.485396 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.485483 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.485709 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.485805 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486032 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486118 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486344 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486491 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486673 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486766 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-6-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.486985 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.487085 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.487361 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.487446 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-6-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.487677 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.487758 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.487991 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.488086 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.488310 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.488408 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.488688 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.488778 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.489038 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.489128 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.489355 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.489451 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.489693 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.489796 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490028 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490121 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490335 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490420 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490657 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490761 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.490976 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.491062 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.491280 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.491375 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.491591 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.491683 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.491894 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492019 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492205 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492372 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492508 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492599 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492811 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.492915 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493089 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493205 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493397 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493490 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493675 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493759 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.493990 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494085 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494315 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494406 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494585 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494672 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494817 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.494951 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.495136 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.495222 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.495446 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.495539 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.495751 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.495836 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496057 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496148 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496361 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496455 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496667 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496756 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.496995 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497095 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497299 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497392 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497605 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497689 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497910 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.497993 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.498220 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.498305 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.498529 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.498624 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.498852 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.498938 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.499156 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.499251 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.499475 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.499560 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.499783 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.499867 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.500106 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.500191 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.500413 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.500497 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.500749 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.500832 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.501094 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.501187 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.501405 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.501499 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.501724 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.501818 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502045 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502129 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502354 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502437 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502659 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502756 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.502964 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503056 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503276 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503370 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503585 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503684 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503892 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.503974 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.504141 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.504241 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.504443 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.504536 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.504745 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.504831 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.505088 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.505176 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.505421 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.505521 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.505729 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.505814 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506076 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506168 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506378 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506474 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506685 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506819 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.506991 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507077 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507295 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507387 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507599 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507695 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507903 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.507995 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.508210 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.508295 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.508512 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.508604 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.508816 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.508920 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.509152 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.509252 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.509461 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.509589 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.509771 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.509865 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510076 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510159 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510381 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510474 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510685 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510779 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.510989 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511081 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511300 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511402 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511602 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511686 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511906 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.511992 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.512219 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.512309 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.512522 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.512612 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.512826 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.512955 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.513169 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.513270 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.513477 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.513576 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.513783 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.513880 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.514098 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.514185 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.514400 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.514492 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.514705 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.514791 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515011 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515102 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515316 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515408 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515621 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515713 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.515924 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516008 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516229 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516325 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516534 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516624 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516837 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.516976 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.517170 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.517254 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.517472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.517565 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.517771 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.517863 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.518078 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.518163 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.518381 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.518470 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.518698 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.518781 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519004 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519101 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519306 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519398 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519622 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519705 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.519931 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.520024 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.520255 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:27:05.520348 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.520597 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.520695 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.521477 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.521572 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.521773 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.521862 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.522108 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.522201 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.522427 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.522511 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.522740 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.522824 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523052 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523145 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523378 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523509 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523686 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523778 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.523998 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.524085 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.524311 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.524402 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.524626 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.524709 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.524965 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.525052 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.525290 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.525397 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.525603 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.525688 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.525921 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526019 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526238 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526323 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526549 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526640 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526865 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.526994 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.527176 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.527272 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.527497 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.527582 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.527805 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.527897 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.528140 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.528224 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.528457 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.528543 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.528782 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.528873 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.529135 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.529234 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.529457 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.529549 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.529771 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.529857 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.530083 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.530174 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.530394 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.530487 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.530707 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.530791 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531022 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531107 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531336 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531433 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531656 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531753 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.531969 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.532063 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.532281 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.532376 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.532592 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.532677 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.532931 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533019 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533229 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533325 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533549 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533634 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533864 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.533949 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.534178 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.534263 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.534490 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.534576 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.534807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.534892 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.535119 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.535206 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.535432 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.535528 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.535744 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.535828 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.536048 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.536133 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.536355 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.536440 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.537254 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.537354 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.537567 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.537655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.537877 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.537963 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.538193 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.538277 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.538504 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.538590 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.538830 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539001 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539161 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539255 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539466 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539550 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539780 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.539913 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.540093 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.540187 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.540403 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.540488 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.540708 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.540799 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541143 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541351 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541436 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541657 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541740 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.541968 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542060 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542276 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542360 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542582 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542672 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542903 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.542997 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.543209 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.543300 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.543515 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.543599 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.543825 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.543913 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.544134 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.544225 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.544447 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.544531 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.544757 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.544841 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.545094 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.545191 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.545409 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.545502 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.545720 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.545805 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546033 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546125 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546367 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546462 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546666 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546751 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.546982 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.547067 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.547321 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.547454 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.547624 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.547725 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.547945 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.548043 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.548249 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.548343 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.548559 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.548644 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.548866 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549004 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549196 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549292 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549502 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549587 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549809 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.549893 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.550112 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.550205 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.550416 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.550501 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.550719 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.550806 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551024 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551110 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551328 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551413 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551632 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551717 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.551940 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552033 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552268 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552357 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552571 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552657 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552874 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.552984 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.553221 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.553305 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.553532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.553632 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.553872 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.553955 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.554187 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.554271 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.554513 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.554609 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.554836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.554928 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.555151 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.555243 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.555468 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.555562 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.555781 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.555877 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.556092 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.556184 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.556401 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.556499 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.556711 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.556787 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.557369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.557476 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.557476 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.557620 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.557687 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.557761 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558035 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558136 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558286 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558374 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558601 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558693 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.558921 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559005 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559228 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559322 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559545 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559630 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559854 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.559938 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.560179 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.560268 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.560512 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.560597 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.560836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.560952 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.561175 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.561261 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.561492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.561577 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.561806 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.561900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.562117 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.562211 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.562428 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.562521 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.562740 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.562834 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563053 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563137 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563361 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563444 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563679 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563773 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.563992 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.564078 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.564315 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.564399 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.564623 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.564719 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.564966 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565056 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565273 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565359 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565589 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565676 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565898 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.565983 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.566220 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.566306 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.566537 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.566622 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.566850 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.566943 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.567170 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.567256 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.567487 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.567574 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.567819 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.567910 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.568134 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.568232 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.568438 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.568524 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.568742 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.568827 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.569080 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.569179 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.569395 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.569481 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.569703 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.569787 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570015 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570109 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570321 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570423 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570636 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570721 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.570949 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.571079 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.571256 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.571366 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.571561 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.571660 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.571867 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572046 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572180 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572287 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572487 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572570 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.572952 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.573146 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.573242 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.573450 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.573541 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.573755 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.573840 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574077 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574163 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574387 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574484 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574690 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574775 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.574995 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.575080 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.575298 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.575383 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.575610 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.575699 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.575920 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576013 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576232 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576323 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576550 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576662 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576868 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.576981 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.577208 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.577319 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.577524 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.577614 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.577835 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.577923 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.578412 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.578521 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.578724 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.578812 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579039 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579125 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579350 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579451 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579760 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.579974 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.580062 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.580288 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.580401 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.580598 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.580691 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.580926 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581015 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581244 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581330 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581556 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581642 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581866 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.581952 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.582173 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.582259 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.582483 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.582578 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.582793 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.582878 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.583108 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.583360 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.584000 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.584210 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.584504 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.584597 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.584836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.584941 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.585187 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.585283 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.585510 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.585604 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.585836 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.585928 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.586163 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.586249 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.586497 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.586589 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.586802 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.586894 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.587116 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.587201 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.587429 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.587523 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.587737 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.587835 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588051 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588148 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588357 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588451 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588761 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.588994 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.589084 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.589304 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.589388 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.589608 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.589708 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.589914 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590000 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590302 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590522 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590636 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590828 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.590922 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.591132 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.591216 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.591442 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.591540 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.591746 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.591839 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.592059 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.592144 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.592365 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.592450 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.592667 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.592752 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593000 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593087 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593306 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593399 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593611 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593694 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.593924 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.594009 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.594265 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.594357 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.594572 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.594656 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.594912 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595007 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595216 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595301 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595523 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595608 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595849 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.595942 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.596153 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.596238 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.596457 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.596548 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.596761 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.596941 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.597096 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.597191 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.597403 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.597488 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.597705 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.597801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598017 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598102 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598324 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598415 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598633 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598718 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.598944 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.599028 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.599300 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.599388 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.599612 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.599698 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.599918 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600003 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600230 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600315 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600539 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600624 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600844 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.600977 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.601173 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.601259 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.601480 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.601566 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.601787 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.601885 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.602092 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.602185 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.602402 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.602495 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.602705 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.602796 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603018 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603111 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603321 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603412 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603625 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603711 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.603930 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604024 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604235 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604319 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604542 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604637 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604843 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.604958 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.605191 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.605276 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.605499 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.605584 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.605803 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.605897 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.606109 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.606194 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.606419 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.606504 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.606725 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.606817 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607030 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607114 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607334 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607424 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607642 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607728 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.607956 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.608043 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.608257 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.608341 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.608568 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.608657 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.608874 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609021 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609217 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609327 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609500 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609586 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609806 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.609898 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.610106 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.610198 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.610408 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.610499 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.610711 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.610805 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611013 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611108 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611315 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611407 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611621 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611705 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.611930 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612023 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612232 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612324 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612535 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612621 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.612940 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.613174 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.613260 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.613488 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.613573 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.613836 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.613924 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.614140 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.614224 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.614454 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.614593 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.615301 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.615397 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.615615 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.615711 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.615926 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616011 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616243 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616329 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616550 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616641 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616869 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.616992 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.617201 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.617288 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.617513 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.617604 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.617817 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.617914 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.618121 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.618206 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.618429 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.618512 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.618739 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.618840 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.619048 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.619136 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.619368 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.619453 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.619685 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.619778 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620008 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620092 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620313 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620405 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620621 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620749 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.620951 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621261 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621346 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621659 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621880 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.621965 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.622190 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.622275 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.622499 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.622596 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.622807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.622900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.623118 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.623210 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.623427 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.623514 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.623734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.623831 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.624046 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.624131 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.624355 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.624442 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.624663 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.624749 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625002 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625101 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625311 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625395 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625616 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625701 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.625924 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626083 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626229 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626314 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626540 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626623 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626848 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.626941 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.627160 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.627276 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.627470 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.627589 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.627900 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.627992 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.628205 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.628290 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.628516 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.628604 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.628827 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.628939 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.629169 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.629264 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.629482 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.629574 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.629784 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.629882 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.630106 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.630190 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.630970 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.631094 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.631397 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.631484 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.631707 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.631791 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632016 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632109 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632322 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632408 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632630 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632714 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.632968 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633072 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633276 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633367 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633581 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633666 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633886 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.633979 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.634196 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.634279 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.634500 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.634584 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.634821 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.634927 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.635128 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.635242 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.635451 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.635556 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.635863 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.635954 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.636177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.636262 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.636485 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.636570 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.636880 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.636982 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.637228 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.637314 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.637543 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.637627 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.637864 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.637948 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.638170 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.638256 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.638485 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.638589 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.638796 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.638882 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.639113 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.639198 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.639427 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.639513 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.639737 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.639829 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.640053 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.640145 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.640363 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.640449 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.640679 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.640763 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641019 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641146 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641331 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641424 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641652 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641750 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.641968 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.642053 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.642296 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.642388 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.642672 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.642765 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.642995 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.643083 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.643320 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.643407 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.643626 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.643720 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.643929 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644027 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644237 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644323 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644543 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644637 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644847 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.644947 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.645181 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.645267 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.645484 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.645569 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.645795 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.645898 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.646132 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.646221 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.646439 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.646525 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.646750 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.646836 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647056 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647148 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647360 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647445 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647667 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647754 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.647985 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.648076 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.648291 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.648376 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.648613 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.648698 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.648953 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649054 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649260 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649345 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649583 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649668 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649889 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.649983 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.650192 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.650284 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.650497 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.650583 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.650802 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.650910 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.651108 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.651237 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.651415 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.651502 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.651742 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.651839 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.652055 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.652140 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.652380 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.652471 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.652691 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.652776 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.653048 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.653139 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.653365 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.653449 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.653685 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.653771 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654007 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654099 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654326 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654410 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654629 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654714 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.654935 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655020 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655247 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655332 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655566 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655670 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655858 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.655947 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.656161 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.656256 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.656467 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.656551 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.656773 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.656858 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.657102 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.657207 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.657407 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.657500 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.657709 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.657793 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658014 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658108 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658335 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658420 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658639 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658730 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.658942 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659034 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659246 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659332 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659551 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659644 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659856 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.659941 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.660160 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.660246 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.660504 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.660596 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.660807 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.660911 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.661158 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.661253 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.661477 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.662090 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.662319 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.662406 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.662647 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.662734 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.662963 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.663048 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.663279 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.663372 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.663595 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.663682 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.663913 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.664012 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.664229 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.664314 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.664545 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.664630 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.664861 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665029 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665195 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665281 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665511 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665606 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665824 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.665917 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.666138 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.666231 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.666454 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.666659 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.666775 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.666989 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.667299 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.667386 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.667610 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.667696 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.667923 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668010 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668236 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668321 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668547 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668638 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668858 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.668965 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.669194 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.669289 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.669503 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.669588 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.669812 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.669898 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.670123 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.670207 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.670437 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.670532 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.670764 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.670850 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.671088 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.671172 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.671402 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.671494 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.671717 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.671803 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.672033 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.672119 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.672346 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.672440 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.672662 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.672747 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673013 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673102 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673323 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673411 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673638 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673723 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.673954 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674112 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674270 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674357 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674581 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674667 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674892 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.674985 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.675205 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.675290 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.675516 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.675607 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.675827 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.675920 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.676138 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.676224 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.676449 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.676541 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.676759 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.676854 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.677102 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.677252 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.677472 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.677560 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.677802 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.677898 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.678119 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.678205 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.678438 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.678524 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.678756 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.678843 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.679073 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.679276 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.679396 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.679593 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.679920 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680007 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680243 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680336 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680566 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680667 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680883 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.680990 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.681221 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.681310 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.681544 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.681701 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.681851 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.681942 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.682155 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.682249 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.682466 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.682564 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.682776 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.682863 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.683076 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.683160 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.683400 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.683503 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.683706 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.683792 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684008 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684093 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684325 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684412 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684630 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684723 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.684982 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.685189 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.685333 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.685536 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.685821 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.685907 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.686164 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.686249 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.686484 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.686569 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.686798 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.686890 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.687106 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.687193 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.687437 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.687524 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.687743 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.687828 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688049 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688142 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688365 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688450 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688673 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688765 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.688999 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.689102 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.689306 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.689392 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.689616 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.689702 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.689923 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690016 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690227 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690310 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690536 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690622 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690840 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.690947 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.691150 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.691235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.691457 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.691542 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.691761 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.691850 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.692066 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.692159 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.692377 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.692462 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.692681 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.693346 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.693539 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.693642 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.693848 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.693933 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.694151 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.694243 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.694459 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.694543 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.694760 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.694844 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695071 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695158 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695377 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695462 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695684 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695782 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.695990 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.696084 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.696298 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.696383 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.696602 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.696699 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.696935 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.697049 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.697297 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.697385 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.697627 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.697721 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.697939 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698026 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698249 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698336 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698569 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698663 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698882 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.698967 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.699195 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.699281 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.699515 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.699610 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.699830 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.699916 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.700183 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.700370 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.700503 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.700709 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.701055 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.701154 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.701391 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.701479 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.701721 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.701807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702028 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702112 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702335 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702420 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702641 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702727 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.702962 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.703048 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.703539 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.703636 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.703850 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.703935 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.704163 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.704249 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.704477 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.704574 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.704786 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.704872 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.705122 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.705209 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.705435 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.705533 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.705746 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.705832 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706056 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706142 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706366 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706453 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706676 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706761 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.706987 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.707072 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.707296 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.707381 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.707605 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.707690 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.707920 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.708011 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.708235 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.708321 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.708607 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.708696 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.708976 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.709076 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.709297 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.709398 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.709618 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.709704 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.709932 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710027 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710244 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710330 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710557 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710651 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710871 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.710966 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.711185 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.711270 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.711504 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.711589 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.711816 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.711903 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.712123 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.712216 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.712454 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.712539 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.712766 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.712853 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.713174 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.713259 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.713495 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.713580 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.713807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.713916 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.714130 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.714216 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.714444 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.714538 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.714753 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.714839 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.715073 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.715168 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.715385 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.715484 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.715707 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.715795 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.716020 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.716116 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.716353 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.716448 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.716675 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.716761 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717010 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717100 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717320 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717411 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717624 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717710 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.717938 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718031 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718251 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718337 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718561 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718645 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718865 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.718949 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.719168 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.719262 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.719477 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.719562 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.719781 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.719875 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.720084 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.720172 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.720388 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.720473 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.720691 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.720784 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721023 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721113 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721329 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721413 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721633 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721731 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.721937 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722029 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722239 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722323 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722540 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722638 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722843 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.722929 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.723148 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.723233 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.723451 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.723544 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.723757 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.723862 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.724578 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.724680 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.724963 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725058 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725208 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725302 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725512 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725598 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725821 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.725917 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.726157 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.726244 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.726478 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.726562 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.726790 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.726878 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.727111 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.727204 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.727422 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.727515 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.727744 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.727830 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.728057 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.728143 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.728378 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.728471 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.728688 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.728774 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729044 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729135 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729357 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729456 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729668 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729762 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.729979 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730065 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730286 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730384 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730598 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730685 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730908 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.730995 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.731235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.731328 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.731551 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.731642 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.731856 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.731939 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.732180 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.732276 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.732495 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.732583 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.732817 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.732941 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.733158 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.733246 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.733469 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.733555 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.733793 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.733912 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.734103 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.734204 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.734412 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.734514 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.734720 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.734829 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735032 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735130 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735343 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735447 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735656 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735778 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.735963 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736063 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736274 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736360 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736586 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736679 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736907 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.736995 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.737244 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.737329 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.737563 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.737658 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.737871 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.737956 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.738203 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.738288 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.738514 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.738599 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.738845 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.738930 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.739159 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.739243 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.739503 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.739598 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.739871 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.739962 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.740188 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.740281 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.740501 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.740587 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.740807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.740969 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.741074 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:27:05.741234 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.741471 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:27:05.741717 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:27:05.894340 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Registered counter for database nova_api Jul 27 16:27:05.895700 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Registered counter for database nova_api Jul 27 16:27:05.916775 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:05.917949 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:05.922619 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:05.924369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:05.979237 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.context [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ee659ef-ec36-43e2-848b-212ef900904c(cell1) {{(pid=103272) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 16:27:05.981469 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.context [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ee659ef-ec36-43e2-848b-212ef900904c(cell1) {{(pid=103271) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 16:27:05.983148 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:27:05.984778 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:27:05.985405 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:27:05.985586 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:27:05.987008 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:27:05.987553 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:27:05.987809 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:27:05.989537 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Registered counter for database nova_cell0 Jul 27 16:27:05.990403 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:27:05.992389 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Registered counter for database nova_cell0 Jul 27 16:27:05.995430 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Registered counter for database nova_cell1 Jul 27 16:27:05.997763 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Registered counter for database nova_cell1 Jul 27 16:27:06.003417 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:06.004792 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:06.006563 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:06.009988 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:06.011177 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:06.012851 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:06.013940 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:06.151314 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:06.156390 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Registered counter for database nova_cell0 Jul 27 16:27:06.160137 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Registered counter for database nova_cell0 Jul 27 16:27:06.166432 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:06.169597 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:27:06.171146 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:06.174349 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:27:06.505672 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:27:06.512900 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:27:06.516164 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:27:06.523482 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:27:06.856511 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:27:06.862419 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:27:06.867664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb7f97a9c0 pid: 103272 (default app) Jul 27 16:27:06.869625 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:27:06.869765 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:27:06.870945 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] 10.222.0.74 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jul 27 16:27:06.871361 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 788 bytes} [Wed Jul 27 16:27:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:27:06.876560 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3b2e3748-1c4c-4c21-b31d-44ace8c1d675 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:27:06.881963 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb7f97a9c0 pid: 103271 (default app) Jul 27 16:28:22.495568 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:22.496576 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 27 16:28:22.500016 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:22.513626 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:22.514578 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:22.515639 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:22.516556 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:23.411746 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-66c313f4-d09a-4960-8c12-a647d7c9035e admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:23.446401 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-66c313f4-d09a-4960-8c12-a647d7c9035e admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.941799 Jul 27 16:28:23.447176 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 1/3] 10.222.0.74 () {60 vars in 1291 bytes} [Wed Jul 27 16:28:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:25.661358 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:25.662475 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c878a21b-06cb-4212-8975-38fd153de863 None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Jul 27 16:28:25.663266 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 3/4] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:26.099081 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4147ac78-1ab9-4571-8dd0-7afc95864a0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "ram": 256, "vcpus": 1, "disk": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:26.118995 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:28:26.118995 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 27 16:28:26.146867 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-4147ac78-1ab9-4571-8dd0-7afc95864a0e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475283 Jul 27 16:28:26.147614 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 2/5] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:28:26.161380 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:26.162227 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:26.166517 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:26.166517 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:26.371473 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b94d09b0-3d5d-4a88-8515-da5883348309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:26.375807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:28:26.375807 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 27 16:28:26.443348 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-b94d09b0-3d5d-4a88-8515-da5883348309 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287121 Jul 27 16:28:26.444144 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 4/6] 10.222.0.74 () {64 vars in 1335 bytes} [Wed Jul 27 16:28:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:28.715635 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4147ac78-1ab9-4571-8dd0-7afc95864a0e admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:28.716738 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-4147ac78-1ab9-4571-8dd0-7afc95864a0e admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jul 27 16:28:28.717415 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 3/7] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:29.402540 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-966793b7-0ee7-4bd0-b2e1-ce241094b6b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:29.421594 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:28:29.421594 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 27 16:28:29.442257 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-966793b7-0ee7-4bd0-b2e1-ce241094b6b1 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.718723 Jul 27 16:28:29.442810 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 5/8] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:28:29.455172 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-4efca962-64d8-4e88-bd73-56bd12f4b23e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:29.458051 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:28:29.458051 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 27 16:28:29.493558 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-4efca962-64d8-4e88-bd73-56bd12f4b23e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042412 Jul 27 16:28:29.494141 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 4/9] 10.222.0.74 () {64 vars in 1335 bytes} [Wed Jul 27 16:28:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:28:31.709450 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-966793b7-0ee7-4bd0-b2e1-ce241094b6b1 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:31.710788 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-966793b7-0ee7-4bd0-b2e1-ce241094b6b1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 27 16:28:31.711197 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:32.123175 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-71b15f5d-36a4-401f-b6d5-f7499287e636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "id": "d2", "disk": 10}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:32.142515 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-71b15f5d-36a4-401f-b6d5-f7499287e636 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423041 Jul 27 16:28:32.142515 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 5/11] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:28:32.154458 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-945b5090-b9bf-400c-adfc-1eb2ef64623b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:32.179278 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-945b5090-b9bf-400c-adfc-1eb2ef64623b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028565 Jul 27 16:28:32.179833 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 7/12] 10.222.0.74 () {64 vars in 1335 bytes} [Wed Jul 27 16:28:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:34.446298 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-71b15f5d-36a4-401f-b6d5-f7499287e636 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:34.447880 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-71b15f5d-36a4-401f-b6d5-f7499287e636 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Jul 27 16:28:34.448733 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 6/13] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:34.889726 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e3f10ece-cb26-45dd-a641-fb99d0a74db6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:34.917248 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e3f10ece-cb26-45dd-a641-fb99d0a74db6 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461798 Jul 27 16:28:34.918366 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 8/14] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:28:34.931471 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ca48868b-558b-4e55-8b56-2180a778b2b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:34.959155 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ca48868b-558b-4e55-8b56-2180a778b2b0 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031257 Jul 27 16:28:34.960127 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 7/15] 10.222.0.74 () {64 vars in 1335 bytes} [Wed Jul 27 16:28:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:37.157612 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e3f10ece-cb26-45dd-a641-fb99d0a74db6 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:37.158627 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e3f10ece-cb26-45dd-a641-fb99d0a74db6 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 27 16:28:37.159025 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 9/16] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:37.590659 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-04e3f9da-8152-4cbe-bee0-cad9f4323271 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:37.619193 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-04e3f9da-8152-4cbe-bee0-cad9f4323271 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454125 Jul 27 16:28:37.620119 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 8/17] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:28:37.638487 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-804f9031-9d21-4d83-979a-8370a9d993f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:37.663941 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-804f9031-9d21-4d83-979a-8370a9d993f7 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035447 Jul 27 16:28:37.681207 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 10/18] 10.222.0.74 () {64 vars in 1335 bytes} [Wed Jul 27 16:28:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:28:39.915106 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-04e3f9da-8152-4cbe-bee0-cad9f4323271 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:39.916171 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-04e3f9da-8152-4cbe-bee0-cad9f4323271 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 27 16:28:39.916598 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 9/19] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:40.362330 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-43a9f290-b4cd-4e31-af9d-6ac6aab86207 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:40.386753 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-43a9f290-b4cd-4e31-af9d-6ac6aab86207 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463989 Jul 27 16:28:40.387288 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 11/20] 10.222.0.74 () {60 vars in 1291 bytes} [Wed Jul 27 16:28:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:28:42.596210 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-04e3f9da-8152-4cbe-bee0-cad9f4323271 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:42.597489 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-04e3f9da-8152-4cbe-bee0-cad9f4323271 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jul 27 16:28:42.597950 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 10/21] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:43.085414 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1c18d813-6861-44f5-823c-87f0ecdaf63a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 1, "id": "1", "vcpus": 1}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:43.106842 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1c18d813-6861-44f5-823c-87f0ecdaf63a admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.502738 Jul 27 16:28:43.107511 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 12/22] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:28:43.119435 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f2d16a6c-a9ef-481c-b9fb-33189ee4c542 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:43.145997 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f2d16a6c-a9ef-481c-b9fb-33189ee4c542 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030183 Jul 27 16:28:43.146728 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 11/23] 10.222.0.74 () {64 vars in 1332 bytes} [Wed Jul 27 16:28:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:45.353967 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1c18d813-6861-44f5-823c-87f0ecdaf63a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:45.354988 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1c18d813-6861-44f5-823c-87f0ecdaf63a admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 27 16:28:45.355386 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:45.756612 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bde692d5-f306-4e6c-bc0f-f8a21277437e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:45.775715 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bde692d5-f306-4e6c-bc0f-f8a21277437e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414633 Jul 27 16:28:45.776494 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 12/25] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:28:45.788713 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-62ad0f28-a2d7-4614-8623-de5f53480758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:45.812816 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-62ad0f28-a2d7-4614-8623-de5f53480758 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028342 Jul 27 16:28:45.813410 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 14/26] 10.222.0.74 () {64 vars in 1332 bytes} [Wed Jul 27 16:28:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:47.995079 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bde692d5-f306-4e6c-bc0f-f8a21277437e admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:47.996120 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bde692d5-f306-4e6c-bc0f-f8a21277437e admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 27 16:28:47.996711 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 13/27] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:48.372247 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a9d0facf-25b7-434a-96c1-114bf14e4e3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:48.394529 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a9d0facf-25b7-434a-96c1-114bf14e4e3b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.391677 Jul 27 16:28:48.395364 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 15/28] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:28:48.407549 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2016435e-fbe2-4cf9-9b10-dc79c3536e6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:48.431909 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2016435e-fbe2-4cf9-9b10-dc79c3536e6a admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028265 Jul 27 16:28:48.432422 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 14/29] 10.222.0.74 () {64 vars in 1332 bytes} [Wed Jul 27 16:28:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:50.689468 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a9d0facf-25b7-434a-96c1-114bf14e4e3b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:50.691146 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a9d0facf-25b7-434a-96c1-114bf14e4e3b admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Jul 27 16:28:50.691999 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 16/30] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:51.140862 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d70ae421-934e-48d0-a459-47f8db5ea0a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "name": "m1.large"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:51.167831 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d70ae421-934e-48d0-a459-47f8db5ea0a0 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470340 Jul 27 16:28:51.168662 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 15/31] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:28:51.180454 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b7adbffa-9dc5-4d1c-a7d3-e58df9b381b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:51.204070 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-b7adbffa-9dc5-4d1c-a7d3-e58df9b381b6 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027369 Jul 27 16:28:51.204644 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 17/32] 10.222.0.74 () {64 vars in 1332 bytes} [Wed Jul 27 16:28:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:28:53.429638 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d70ae421-934e-48d0-a459-47f8db5ea0a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:28:53.430572 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d70ae421-934e-48d0-a459-47f8db5ea0a0 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 27 16:28:53.431157 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 16/33] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:28:53.886755 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-aacb6ea1-1d2a-4b42-ada0-92a8a5292405 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:53.913606 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-aacb6ea1-1d2a-4b42-ada0-92a8a5292405 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475087 Jul 27 16:28:53.913606 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1282 bytes} [Wed Jul 27 16:28:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:28:53.926911 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7ae388ca-1dd8-4e4a-975d-95c5cd2d2d53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:28:53.932113 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:53.971415 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-7ae388ca-1dd8-4e4a-975d-95c5cd2d2d53 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048960 Jul 27 16:28:53.972748 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 17/35] 10.222.0.74 () {64 vars in 1332 bytes} [Wed Jul 27 16:28:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:29:13.952087 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-aacb6ea1-1d2a-4b42-ada0-92a8a5292405 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:13.953230 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-aacb6ea1-1d2a-4b42-ada0-92a8a5292405 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 27 16:29:13.953626 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 19/36] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:13.964755 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:14.340247 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e7ea5675-8102-4ce4-938a-d9fe6b12d348 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:14.358598 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e7ea5675-8102-4ce4-938a-d9fe6b12d348 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398259 Jul 27 16:29:14.359124 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1291 bytes} [Wed Jul 27 16:29:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:29:15.455012 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-aacb6ea1-1d2a-4b42-ada0-92a8a5292405 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:15.457052 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-aacb6ea1-1d2a-4b42-ada0-92a8a5292405 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002463 Jul 27 16:29:15.457481 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 20/38] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:15.987437 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e45730a4-e076-4a77-b8f9-55ef2f6b1284 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:15.993039 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-e45730a4-e076-4a77-b8f9-55ef2f6b1284 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e45730a4-e076-4a77-b8f9-55ef2f6b1284 admin admin] Request method failure captured: Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Host: 10.222.0.74 Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi4WfbwIpsjp3fDEjl5iPyQiJSB43xqFAG7TdXf4CbLiF2YCOfJbj8vFN8N3yhw84Agjljk3EMff1WUJW7OiVOmiewPMHlQN5SueBDJuvLbnY6yB2dA01bbaBcvo0uqeNpjcNYWbKJfBRaqC5mijjsPsFaAkp6xprJpaa8yxSMQmakq8Q Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Role: reader,admin,member Jul 27 16:29:15.996379 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Roles: reader,admin,member Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User: admin Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Id: 2682f5470265422cbaaa91dfd16e8ea6 Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: method: > Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: exception: Flavor 42 could not be found. Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: action_args: {'id': '42'} Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:29:15.998041 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:15.999177 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.000532 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-e45730a4-e076-4a77-b8f9-55ef2f6b1284 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:29:16.001907 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-e45730a4-e076-4a77-b8f9-55ef2f6b1284 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402011 Jul 27 16:29:16.001907 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1190 bytes} [Wed Jul 27 16:29:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:16.009202 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a132711e-991e-4210-874c-660264e702d1 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:16.013361 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:16.033506 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a132711e-991e-4210-874c-660264e702d1 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028438 Jul 27 16:29:16.034045 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 21/40] 10.222.0.74 () {60 vars in 1210 bytes} [Wed Jul 27 16:29:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:29:16.043742 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ae8de7dd-2e7f-4f6d-b32d-ed8c2157098f admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:16.069478 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ae8de7dd-2e7f-4f6d-b32d-ed8c2157098f admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028976 Jul 27 16:29:16.070348 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 20/41] 10.222.0.74 () {60 vars in 1210 bytes} [Wed Jul 27 16:29:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:29:16.079863 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b57d75d0-3308-4247-abb3-30258a30d2a3 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:16.086799 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-b57d75d0-3308-4247-abb3-30258a30d2a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b57d75d0-3308-4247-abb3-30258a30d2a3 admin admin] Request method failure captured: Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Host: 10.222.0.74 Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi4WfbwIpsjp3fDEjl5iPyQiJSB43xqFAG7TdXf4CbLiF2YCOfJbj8vFN8N3yhw84Agjljk3EMff1WUJW7OiVOmiewPMHlQN5SueBDJuvLbnY6yB2dA01bbaBcvo0uqeNpjcNYWbKJfBRaqC5mijjsPsFaAkp6xprJpaa8yxSMQmakq8Q Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Role: reader,admin,member Jul 27 16:29:16.090235 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Roles: reader,admin,member Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User: admin Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Id: 2682f5470265422cbaaa91dfd16e8ea6 Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: method: > Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: exception: Flavor 42 could not be found. Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: action_args: {'id': '42'} Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:29:16.091655 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:16.092472 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:16.093572 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b57d75d0-3308-4247-abb3-30258a30d2a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:29:16.094573 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-b57d75d0-3308-4247-abb3-30258a30d2a3 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015439 Jul 27 16:29:16.094573 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 22/42] 10.222.0.74 () {60 vars in 1190 bytes} [Wed Jul 27 16:29:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:17.054332 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ae8de7dd-2e7f-4f6d-b32d-ed8c2157098f admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:17.055332 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ae8de7dd-2e7f-4f6d-b32d-ed8c2157098f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 27 16:29:17.055719 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 21/43] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:17.573546 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e154b6c3-4f92-4f15-b858-977b66805867 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:17.578896 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-e154b6c3-4f92-4f15-b858-977b66805867 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e154b6c3-4f92-4f15-b858-977b66805867 admin admin] Request method failure captured: Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Host: 10.222.0.74 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi4Wfcp0UOYG2N4Ej_ELsBO5I8HdaFlKzz2hPD_-guPR3Amwex1v5nKGgcxqocf6Ojr176gqMd98syEShpsCVM3G3TxlvUrsgEXcrLY1ULNXUVs_1zN-OEly--0ivShYhK21qxJ69eoVZ9-MlLKK7RGX--HJ479ObxYcLHemx8WCXSrc0 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Role: reader,admin,member Jul 27 16:29:17.581149 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Roles: reader,admin,member Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User: admin Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Id: 2682f5470265422cbaaa91dfd16e8ea6 Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: method: > Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: exception: Flavor 84 could not be found. Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: action_args: {'id': '84'} Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:29:17.582664 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:17.583734 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.585218 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e154b6c3-4f92-4f15-b858-977b66805867 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:29:17.586502 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e154b6c3-4f92-4f15-b858-977b66805867 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389959 Jul 27 16:29:17.586502 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 23/44] 10.222.0.74 () {60 vars in 1190 bytes} [Wed Jul 27 16:29:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:17.592092 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7937abb9-cf96-4b16-8816-37eeff9a9861 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:17.607254 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-7937abb9-cf96-4b16-8816-37eeff9a9861 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018744 Jul 27 16:29:17.607772 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 22/45] 10.222.0.74 () {60 vars in 1210 bytes} [Wed Jul 27 16:29:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:29:17.616824 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-2dc3941d-4609-4227-8426-6e83e39c8bfa admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:17.632142 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-2dc3941d-4609-4227-8426-6e83e39c8bfa admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018716 Jul 27 16:29:17.632658 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 24/46] 10.222.0.74 () {60 vars in 1210 bytes} [Wed Jul 27 16:29:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:29:17.641611 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-81c2ca37-79ff-4ab4-b47c-8c7b19a55c0c admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:17.647401 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-81c2ca37-79ff-4ab4-b47c-8c7b19a55c0c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-81c2ca37-79ff-4ab4-b47c-8c7b19a55c0c admin admin] Request method failure captured: Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Host: 10.222.0.74 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi4Wfcp0UOYG2N4Ej_ELsBO5I8HdaFlKzz2hPD_-guPR3Amwex1v5nKGgcxqocf6Ojr176gqMd98syEShpsCVM3G3TxlvUrsgEXcrLY1ULNXUVs_1zN-OEly--0ivShYhK21qxJ69eoVZ9-MlLKK7RGX--HJ479ObxYcLHemx8WCXSrc0 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Role: reader,admin,member Jul 27 16:29:17.648900 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Roles: reader,admin,member Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User: admin Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Id: 2682f5470265422cbaaa91dfd16e8ea6 Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: method: > Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: exception: Flavor 84 could not be found. Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: action_args: {'id': '84'} Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:29:17.650369 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:17.651214 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:17.652278 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-81c2ca37-79ff-4ab4-b47c-8c7b19a55c0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:29:17.653305 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-81c2ca37-79ff-4ab4-b47c-8c7b19a55c0c admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012088 Jul 27 16:29:17.653305 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 23/47] 10.222.0.74 () {60 vars in 1190 bytes} [Wed Jul 27 16:29:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 16:29:18.621220 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-2dc3941d-4609-4227-8426-6e83e39c8bfa admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:18.622264 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-2dc3941d-4609-4227-8426-6e83e39c8bfa admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 27 16:29:18.622658 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 25/48] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:19.142335 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-99290b49-99a0-4929-b912-36ddf4d0f4f7 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:19.148639 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-99290b49-99a0-4929-b912-36ddf4d0f4f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-99290b49-99a0-4929-b912-36ddf4d0f4f7 admin admin] Request method failure captured: Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Host: 10.222.0.74 Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi4WfeufBoTR4DASHCBq7wmOghYLhseiWsSUd_QFOz-0-3tg7iUjywqIV3951qmGT6X8HoYjjwiKJjAoPya1xaMiWg-edr6as4BlYFJOyl0ZcTnXlrZ0AeQV0Ei2l8x4kGjb8UyPwKRLLNLLkfpjNCL-numxbP8tkJHnfD7b5kuAJ2NbQ Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Role: reader,admin,member Jul 27 16:29:19.150143 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Roles: reader,admin,member Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User: admin Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Id: 2682f5470265422cbaaa91dfd16e8ea6 Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: method: > Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: exception: Flavor 451 could not be found. Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: action_args: {'id': '451'} Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:29:19.151669 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:19.152801 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.154486 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-99290b49-99a0-4929-b912-36ddf4d0f4f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:29:19.155892 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-99290b49-99a0-4929-b912-36ddf4d0f4f7 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391243 Jul 27 16:29:19.155892 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 24/49] 10.222.0.74 () {60 vars in 1193 bytes} [Wed Jul 27 16:29:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:19.161043 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1f2e4487-24e4-4fd4-9da0-d152d149c876 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:19.176534 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1f2e4487-24e4-4fd4-9da0-d152d149c876 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018911 Jul 27 16:29:19.177123 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 26/50] 10.222.0.74 () {60 vars in 1210 bytes} [Wed Jul 27 16:29:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:29:19.186513 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:19.201734 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018751 Jul 27 16:29:19.202248 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 25/51] 10.222.0.74 () {60 vars in 1210 bytes} [Wed Jul 27 16:29:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:29:19.212006 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b1e15764-bbdb-4c5c-8f61-e509b6543b33 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:19.217335 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-b1e15764-bbdb-4c5c-8f61-e509b6543b33 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b1e15764-bbdb-4c5c-8f61-e509b6543b33 admin admin] Request method failure captured: Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Host: 10.222.0.74 Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi4WfeufBoTR4DASHCBq7wmOghYLhseiWsSUd_QFOz-0-3tg7iUjywqIV3951qmGT6X8HoYjjwiKJjAoPya1xaMiWg-edr6as4BlYFJOyl0ZcTnXlrZ0AeQV0Ei2l8x4kGjb8UyPwKRLLNLLkfpjNCL-numxbP8tkJHnfD7b5kuAJ2NbQ Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Role: reader,admin,member Jul 27 16:29:19.218818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Roles: reader,admin,member Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0d94f0c6f55c441591df5c2cef40a859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 0d94f0c6f55c441591df5c2cef40a859 Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User: admin Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Id: 2682f5470265422cbaaa91dfd16e8ea6 Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: method: > Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: exception: Flavor 451 could not be found. Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: action_args: {'id': '451'} Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:29:19.220492 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:19.221519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 27 16:29:19.222836 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b1e15764-bbdb-4c5c-8f61-e509b6543b33 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:29:19.224179 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-b1e15764-bbdb-4c5c-8f61-e509b6543b33 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011711 Jul 27 16:29:19.224179 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 27/52] 10.222.0.74 () {60 vars in 1193 bytes} [Wed Jul 27 16:29:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 16:29:20.191275 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:20.192272 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 27 16:29:20.192653 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:20.706770 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-07516e72-bbec-4189-96bf-259938f84124 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:29:20.724840 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-07516e72-bbec-4189-96bf-259938f84124 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.396579 Jul 27 16:29:20.725380 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 28/54] 10.222.0.74 () {64 vars in 1235 bytes} [Wed Jul 27 16:29:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:29:21.676484 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:21.677529 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 27 16:29:21.677923 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:22.350659 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-b3bd8994-c70a-451b-9436-e632bbec6618 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:29:22.368246 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-b3bd8994-c70a-451b-9436-e632bbec6618 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.552403 Jul 27 16:29:22.368779 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 29/56] 10.222.0.74 () {64 vars in 1235 bytes} [Wed Jul 27 16:29:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:29:23.327429 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:23.328428 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 27 16:29:23.328810 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 28/57] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:23.845683 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-242923b8-f4b9-4389-a14f-ebf98c03a2d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:29:23.863981 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-242923b8-f4b9-4389-a14f-ebf98c03a2d3 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398527 Jul 27 16:29:23.864528 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 30/58] 10.222.0.74 () {64 vars in 1235 bytes} [Wed Jul 27 16:29:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:29:24.831938 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:24.832970 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 27 16:29:24.833364 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 29/59] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:25.360642 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-50eacb24-2959-42dd-b2a4-bb3f54dc7209 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:29:25.379346 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-50eacb24-2959-42dd-b2a4-bb3f54dc7209 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408137 Jul 27 16:29:25.379886 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 31/60] 10.222.0.74 () {64 vars in 1235 bytes} [Wed Jul 27 16:29:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:29:26.358064 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:26.359073 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 27 16:29:26.359488 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 30/61] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:29:26.877041 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-ef95d3c8-97e6-414f-aabb-6c0ac580a163 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:29:26.898300 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-ef95d3c8-97e6-414f-aabb-6c0ac580a163 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401424 Jul 27 16:29:26.899032 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 32/62] 10.222.0.74 () {60 vars in 1202 bytes} [Wed Jul 27 16:29:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:30:18.209238 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:30:18.210273 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c0b30576-0fbd-4b4e-a169-171e6efbf122 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 27 16:30:18.210665 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 930 bytes} [Wed Jul 27 16:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:30:18.221486 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:18.604065 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-354f9d87-f370-4548-809d-9c9914ec4356 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:30:18.624176 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-354f9d87-f370-4548-809d-9c9914ec4356 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407769 Jul 27 16:30:18.624656 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 33/64] 10.222.0.74 () {60 vars in 1291 bytes} [Wed Jul 27 16:30:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:30:18.648731 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b352e2d8-9086-46b8-9b1e-f353c6f25c89 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:30:18.652122 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=14 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:18.657261 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b352e2d8-9086-46b8-9b1e-f353c6f25c89 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012043 Jul 27 16:30:18.657803 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 32/65] 10.222.0.74 () {60 vars in 1282 bytes} [Wed Jul 27 16:30:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:30:18.668955 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-81bc82d4-7d6c-4804-a1c6-a00317be4af2 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:30:18.676320 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-81bc82d4-7d6c-4804-a1c6-a00317be4af2 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010833 Jul 27 16:30:18.676823 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 34/66] 10.222.0.74 () {60 vars in 1285 bytes} [Wed Jul 27 16:30:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:30:18.687780 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:30:18.695536 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011509 Jul 27 16:30:18.696043 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 33/67] 10.222.0.74 () {60 vars in 1285 bytes} [Wed Jul 27 16:30:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:30:18.707726 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-dc9aaf14-5751-4f68-92a8-cb4a27305af0 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:30:18.715038 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-dc9aaf14-5751-4f68-92a8-cb4a27305af0 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011621 Jul 27 16:30:18.715543 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 35/68] 10.222.0.74 () {60 vars in 1282 bytes} [Wed Jul 27 16:30:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:33:42.387988 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:42.389038 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 27 16:33:42.389428 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 34/69] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:33:42.529131 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=6 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:33:42.684436 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-53f91a4b-4471-4966-9c68-81ed8c0c8934 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:42.686828 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:33:42.686828 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 27 16:33:42.688099 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-53f91a4b-4471-4966-9c68-81ed8c0c8934 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:42.688618 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-53f91a4b-4471-4966-9c68-81ed8c0c8934 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:42.689935 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-53f91a4b-4471-4966-9c68-81ed8c0c8934 admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:42.690369 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-53f91a4b-4471-4966-9c68-81ed8c0c8934 admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:42.723732 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-53f91a4b-4471-4966-9c68-81ed8c0c8934 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196053 Jul 27 16:33:42.724302 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 36/70] 10.222.0.74 () {60 vars in 1193 bytes} [Wed Jul 27 16:33:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:33:43.551860 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:43.552905 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 27 16:33:43.553285 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 35/71] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:33:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:33:43.744633 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-38bf4b8b-9531-4dc6-84de-57b20679d6a9 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:43.747219 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:33:43.747219 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 27 16:33:43.748422 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-38bf4b8b-9531-4dc6-84de-57b20679d6a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:43.748862 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-38bf4b8b-9531-4dc6-84de-57b20679d6a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:43.749677 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-38bf4b8b-9531-4dc6-84de-57b20679d6a9 admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:43.750106 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-38bf4b8b-9531-4dc6-84de-57b20679d6a9 admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:43.770085 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-38bf4b8b-9531-4dc6-84de-57b20679d6a9 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076333 Jul 27 16:33:43.770566 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 37/72] 10.222.0.74 () {60 vars in 1193 bytes} [Wed Jul 27 16:33:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:33:55.031222 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:55.032775 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 27 16:33:55.033455 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 36/73] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:33:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:33:55.175757 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:33:55.176480 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:33:55.177151 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=8 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:33:55.225631 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-d7144351-3597-4512-af01-3699c437f72b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:55.227989 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:33:55.227989 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 27 16:33:55.229216 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-d7144351-3597-4512-af01-3699c437f72b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:55.229679 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-d7144351-3597-4512-af01-3699c437f72b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:55.230465 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-d7144351-3597-4512-af01-3699c437f72b admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:55.230895 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-d7144351-3597-4512-af01-3699c437f72b admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:55.255818 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-d7144351-3597-4512-af01-3699c437f72b admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084511 Jul 27 16:33:55.256367 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 38/74] 10.222.0.74 () {60 vars in 1193 bytes} [Wed Jul 27 16:33:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:33:56.075598 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:56.076638 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a1cd1a60-5aa1-42b4-8737-695fcf6df989 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 27 16:33:56.077062 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 37/75] 10.222.0.74 () {56 vars in 1074 bytes} [Wed Jul 27 16:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:33:56.267137 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-eaf33feb-86e6-4c0a-98ec-cfb136a65213 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:33:56.269519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:33:56.269519 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 27 16:33:56.270690 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-eaf33feb-86e6-4c0a-98ec-cfb136a65213 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:56.271127 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-eaf33feb-86e6-4c0a-98ec-cfb136a65213 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:56.271898 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-eaf33feb-86e6-4c0a-98ec-cfb136a65213 admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:33:56.272353 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-eaf33feb-86e6-4c0a-98ec-cfb136a65213 admin admin] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:33:56.293938 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-eaf33feb-86e6-4c0a-98ec-cfb136a65213 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077722 Jul 27 16:33:56.294423 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 39/76] 10.222.0.74 () {60 vars in 1193 bytes} [Wed Jul 27 16:33:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:34:55.925675 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: Wed Jul 27 16:34:55 2022 - graceful shutdown triggered... Jul 27 16:34:55.925867 dv-cinder-849690-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 16:34:55.927219 dv-cinder-849690-6-iscsi devstack@n-api.service[103271]: Gracefully killing worker 1 (pid: 103271)... Jul 27 16:34:55.927846 dv-cinder-849690-6-iscsi devstack@n-api.service[103272]: Gracefully killing worker 2 (pid: 103272)... Jul 27 16:34:56.927982 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: worker 1 buried after 1 seconds Jul 27 16:34:56.927982 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: worker 2 buried after 1 seconds Jul 27 16:34:56.927982 dv-cinder-849690-6-iscsi devstack@n-api.service[103270]: goodbye to uWSGI. Jul 27 16:34:56.929572 dv-cinder-849690-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 16:34:56.930126 dv-cinder-849690-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 16:34:56.932966 dv-cinder-849690-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 16:34:56.944000 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 16:34:56 2022] *** Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: nodename: dv-cinder-849690-6-iscsi Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: machine: x86_64 Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: clock source: unix Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: pcre jit disabled Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: detected number of CPU cores: 4 Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: current working directory: / Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: detected binary path: /usr/bin/uwsgi-core Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: your processes number limit is 47680 Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: your memory page size is 4096 bytes Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: detected max file descriptor number: 2048 Jul 27 16:34:56.946576 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: lock engine: pthread robust mutexes Jul 27 16:34:56.948125 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: thunder lock: enabled Jul 27 16:34:56.948636 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 16:34:56.948761 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 16:34:56.990619 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: Python main interpreter initialized at 0x55981a12b9c0 Jul 27 16:34:56.990619 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: python threads support enabled Jul 27 16:34:56.990619 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: your server socket listen backlog is limited to 100 connections Jul 27 16:34:56.990619 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: your mercy for graceful operations on workers is 90 seconds Jul 27 16:34:56.991036 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 16:34:56.991036 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: *** Operational MODE: preforking *** Jul 27 16:34:56.991375 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: *** uWSGI is running in multiple interpreter mode *** Jul 27 16:34:56.991375 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: spawned uWSGI master process (pid: 124221) Jul 27 16:34:56.991495 dv-cinder-849690-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 16:34:56.996917 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: spawned uWSGI worker 1 (pid: 124235, cores: 1) Jul 27 16:34:56.996917 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: spawned uWSGI worker 2 (pid: 124236, cores: 1) Jul 27 16:34:56.996917 dv-cinder-849690-6-iscsi devstack@n-api.service[124221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 16:34:57.664852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 16:34:57.679510 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 16:34:58.828628 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:34:58.828628 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: from cryptography.utils import int_from_bytes Jul 27 16:34:58.829312 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:34:58.829312 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: from cryptography.utils import int_from_bytes Jul 27 16:34:58.928422 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:34:58.928422 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: from cryptography.utils import int_from_bytes Jul 27 16:34:58.929021 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:34:58.929021 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: from cryptography.utils import int_from_bytes Jul 27 16:35:01.270620 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:35:01.271213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:35:01.271428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:35:01.271762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:35:01.272021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:35:01.272411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.272741 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.273087 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.273412 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.273744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.274056 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.274376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.274696 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.275022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.275283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.275600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.275925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-6-iscsi {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.276247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.276685 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.277024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.277349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.277657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.277982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.278300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.278802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.279238 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.279547 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.280036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.280276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.280582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.281806 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.282286 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.282639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.283221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.283788 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.284491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-6-iscsi {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.285057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.285536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.286138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.286928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.287503 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.287853 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.288355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.288900 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.289269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.289611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.289945 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.290276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.290606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.290926 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.291249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.291566 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.291894 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.292215 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.292515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.292772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.293111 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.293442 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.293766 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.294148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.294409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.294667 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.295079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.295427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.295799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.296157 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.297189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.297544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.297862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.298180 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.298495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.298809 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.299260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.299680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.300145 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.300532 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.300966 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.301384 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.301642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.301962 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.302312 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.302840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.303210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.303589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.304030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.304553 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.304821 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.305206 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.305650 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.306046 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.306364 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.306646 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.307004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.307320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.307645 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.307957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.308270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.308582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.308902 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.309215 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.309526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.309836 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.310145 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.310454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.310760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.311074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.311381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.311687 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.312079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.312378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.312689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.313021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.313333 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.313642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.313964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.314274 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.314593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.314917 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.315225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.315530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.315850 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.316164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.316474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.316794 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.317122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.317432 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.317752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.318063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.318372 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.318677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.318982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.319289 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.319595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.319904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.320205 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.320506 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.320825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.321180 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.321493 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.321804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.322111 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.322431 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.322772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.323107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.323452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.323770 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.324105 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.324439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.324762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.325100 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.325418 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.325748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.326063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.326377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.326690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.327014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.327337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.327793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.328134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.328501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.328827 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.329386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.329714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.330049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.330374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.330689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.331042 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.331388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.331707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.332036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.333071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.333071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.333071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.333595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.333595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.333942 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.334257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.334583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.334927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.335335 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.335649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.335967 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.336541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.336918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.337229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.337549 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.337867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.338193 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.338513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.338829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.339143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.339451 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.339759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.340064 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.340376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.340683 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.341031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.341365 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.341674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.342009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.342317 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.342630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.342943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.343823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.344135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.344454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.344771 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.345115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.345446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.345764 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.346078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.346408 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.346718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.347025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.347349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.347662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.347981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.348300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.348613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.349037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.349360 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.349676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.350024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.350362 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.350672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.351001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.351333 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.351658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.351964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.352279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.352589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.353025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.353404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.353774 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.355093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.355093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.355093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.355093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.355876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.355876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.356153 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.356304 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.356561 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.356873 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.357253 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.357567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.357917 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.358261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.358588 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.359225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.359702 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.360189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.360662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.361191 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.361517 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.361844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.362175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.362498 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.362827 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.363146 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.363482 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.363801 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.364130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.364439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.364759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.365134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.365480 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.365804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.366133 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.366453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.366773 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.367086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.367407 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.367725 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.368044 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.368370 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.368687 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.369047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.369352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.369680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.369998 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.370944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.370944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.370944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.371376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.371574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.371889 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.372207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.372532 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.372844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.373190 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.373501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.373812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.374122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.375028 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.375358 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.375672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.375986 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.376296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.376615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.376988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.377255 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.377552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.377871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.378213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.378528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.378859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.379181 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.379490 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.379800 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.380131 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.381109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.381109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.381109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.381581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.381725 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.382020 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.382333 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.382655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.382980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.383292 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.383614 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.383925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.384243 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.384573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.384917 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.385225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.385543 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.385858 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.386172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.386488 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.386815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.387130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.387446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.387761 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.388068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.388384 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.388709 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.389335 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.389677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.389998 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.391482 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.391482 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.391793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.391949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.392259 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.392610 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.392942 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.393253 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.393565 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.393874 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.394299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.394487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.394796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.395103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.395419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.395726 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.396032 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.396401 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.396639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.396988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.397357 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.397675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.397982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.398314 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.398626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.398934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.399245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.399553 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.399910 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.400219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.400566 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.401822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.401822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.401822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.401822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.402451 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.402451 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.402769 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.403075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.403389 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.403700 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.404006 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.404323 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.404640 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.405085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.405295 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.405604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.405974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.406281 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.406602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.406914 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.407220 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.407525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.407837 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.408148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.408453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.408765 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.409101 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.409423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.409734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.410043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.410348 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.410661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.411034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.411463 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.412074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.412074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.412379 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.412638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.413066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.413381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.413576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.413889 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.414217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.414538 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.414845 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.415158 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.415468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.415776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.416084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.416396 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.416703 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.417024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.417332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.417639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.417997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.418283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.418596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.418907 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.419217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.419525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.419879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.420188 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.420555 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.420863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.421207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.422499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.422499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.422808 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.423037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.423336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.423653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.423968 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.424285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.424590 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.424923 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.425248 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.425634 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.425877 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.426200 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.426526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.426855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.427160 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.427474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.427789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.428098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.428409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.428721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.429062 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.429387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.429707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.430022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.430338 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.430645 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.430958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.431267 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.431579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.431909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.432904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.432904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.432904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.433528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.433528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.433830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.434165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.434483 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.434800 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.435109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.435426 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.435823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.436059 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.436381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.436689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.437294 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.437612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.437927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.438246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.438554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.438862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.439178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.439509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.439819 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.440127 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.440434 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.440760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.441211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.441538 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.441964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.442299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.442579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.443121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.443308 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.443621 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.443947 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.444273 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.444600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.445562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.445562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.445562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.446175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.446175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.446493 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.446789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.447143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.447422 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.447750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.448067 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.448394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.448615 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:35:01.449130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.449284 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:35:01.449453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.449615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.449803 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.450031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:35:01.450198 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.450432 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.450654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:35:01.450813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.451042 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.451199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:35:01.451350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.451508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.451668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.451847 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.452004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.452253 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.452547 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.453928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.454089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.454240 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.454240 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.454524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.454681 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.454681 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.455059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.455217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.455368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.455533 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.455820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.456004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.456188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.456458 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.456614 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.456774 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.456960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.457117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.457369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849690-6-iscsi {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.457533 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.457695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.457853 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.458020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.458171 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.458333 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.458509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.458509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.458802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.458964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.459116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.459264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.459414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.459563 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.459721 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.459878 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.460036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.460218 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.460369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.460519 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.460677 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.460833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.461047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.461209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.461625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.461809 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.462050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.462301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.462562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.462929 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.464246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.464428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.464584 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.464742 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.464920 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.465089 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.465249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.465410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.465561 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849690-6-iscsi {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.465720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.465901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.466166 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.466166 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.466618 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.466786 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.466937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.467095 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.467245 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.467507 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.467667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.467817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.467967 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.468125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.468838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.469019 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.469286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.469459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.469624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.469775 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.469940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.470098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.470255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.470405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.470563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.470714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.470872 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.471023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.471173 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.471342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.471501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.471660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.471901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.472085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.472239 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.472396 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.472546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.472706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.472882 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.473162 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.473332 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.473921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.474093 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.474276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.474535 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.474699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.474852 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.475009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.475158 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.475158 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.475457 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.475614 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.475922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.476094 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.476261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.476412 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.476563 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.476832 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.477011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.477164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.477326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.477508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.477745 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.478029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.478297 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.478532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.478532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.478842 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.479002 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.479153 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.479310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.479469 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.479620 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.479770 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.479919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.480070 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.480220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.480378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.480540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.480698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.480856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.481065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.481230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.481391 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.481549 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.481707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.481864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.482014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.482174 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.482326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.482483 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.482643 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.482800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.482958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.483117 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.483386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.483570 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.484146 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.484309 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.484471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.484817 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.485010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.485164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.485333 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.485491 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.485650 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.485812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.485962 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.486112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.486269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.486429 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.486593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.486752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.487027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.487193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.487356 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.487515 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.487680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.487929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.488085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.488235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.488386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.488545 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.488695 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.488844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.489078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.489240 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.489397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.489574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.489834 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.490097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.490257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.490423 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.490576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.490576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.490875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.491031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.491031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.491322 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.491481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.491481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.491786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.491786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.492078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.492228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.492386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.492386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.492679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.492835 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.492835 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.493160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.493320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.493320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.493748 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.494308 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.494477 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.494629 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.494629 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.495318 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.495476 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.495637 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.495797 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.495797 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.496091 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.496241 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.496406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.496578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.496578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.496865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.497063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.497063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.497466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.497636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.497789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.497966 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.498189 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.498345 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.498505 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.498679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.498831 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.498989 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.499147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.499297 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.499482 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.499639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.499797 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.499950 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.500100 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.500256 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.500416 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.500573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.500735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.500910 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.501081 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.501241 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.501391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.501541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.502467 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.502719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.502952 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.503200 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.503449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.503717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.503885 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.504429 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.504601 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.504769 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.504979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.505236 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.505397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.505548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.505698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.505857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.506017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.506168 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.506820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.506984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.507165 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.507337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.507594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:35:01.507750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.507901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.508061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.508061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.508457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.508619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.508778 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.508948 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.509116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.509289 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.509442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.509593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.509750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.509907 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510224 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510524 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510681 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510831 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.510993 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.511151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.511320 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.511479 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.511630 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.511798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.512500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.512671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.512830 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.513497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.514963 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.514963 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.515781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.516042 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.516199 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.516360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.516511 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.516669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.516828 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.517018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.517170 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.517333 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.517491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.517647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.517799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.518050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.518209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.518209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.518595 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.518755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.518915 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.519067 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.519309 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.519462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.519613 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.519771 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.519923 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.520074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.520233 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.520392 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.520543 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.520700 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.520851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521362 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521515 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521831 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.521983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.522147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.522305 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.522463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.522614 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.522770 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.522934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.523087 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.523253 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.523405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.523556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.523706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.523885 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.524114 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.524271 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.524774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.524952 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.525112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.525279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.525431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.525582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.525751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.526060 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.526312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.526478 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.526629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.526779 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.526936 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.527087 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.527248 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.527406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.527578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.527744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.527911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.528087 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.528341 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.528499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.528744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.528990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.529150 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.529303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.529466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.529617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.529775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.529926 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.530076 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.530250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.530404 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.531457 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.531624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.531777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.531936 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.531936 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.532284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.532456 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.532756 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.532979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.533137 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.533304 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.533475 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.533636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.533785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.533942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.534111 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.534359 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.534548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535193 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535508 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.535982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.536219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.536489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.536658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.536811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.537021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.537176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.537326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.537484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.537656 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.537834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.538091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.538091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.538755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.539115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.539327 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.539489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.539640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.539792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.539942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.540101 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.540259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.540417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.540576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.540726 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.540906 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.541077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.541229 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.541387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.541552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.541703 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.541862 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542335 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542637 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.542964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.543250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.543250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.543542 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.543700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.543860 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.544019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.544176 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.544352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.544593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.544593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.545368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.545530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.545682 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.545851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.546012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.546174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.546174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.546700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.546857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.546857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.547156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.547306 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.547455 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.547661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.547661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.548066 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.548236 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.548389 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.548539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.548811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.548995 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.549264 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.549423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.549575 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.549725 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.549940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.550103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.550256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.550413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.550572 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.550722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.550873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551189 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551507 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551656 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.551988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.552147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.552297 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.552448 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.552605 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.552764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.552968 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.553128 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.553279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.553430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.553590 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.553750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.553909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.554077 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.554228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.554379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.554536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.554814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.555258 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.555420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.555598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.555887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.556070 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.556070 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.556383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.556640 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.556918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.556918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.557238 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.557238 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.557546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.557546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.557846 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.557998 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.558160 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.558319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.558479 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.558630 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.558802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.559065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.559255 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.559488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.559647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.559808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.559967 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.560126 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.560290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.560442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.560594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.560753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.560944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.561134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.562326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.564292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.566231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.567925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.569259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.570645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.571793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.573161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.574321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.575733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.575733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.575733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.575733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.575733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.575733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.576272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.576272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.576435 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.576766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.577168 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.577532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.578413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.578736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.579051 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.579384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.579717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.580005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.580323 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.580640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.581178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.581496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.581900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.582221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.582540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.583072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.583421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.583782 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.584097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.584419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.585172 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.585302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.585624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.585944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.586261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.586836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.587157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.587469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.587795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.588106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.588417 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.588728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.589069 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.589387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.589701 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.590032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.590350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.590663 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.590980 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.591297 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.591607 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.591917 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.592232 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.592563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.592883 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.593941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.594397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.594955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.595517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.596080 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.596422 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.596749 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.597098 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.597421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.597743 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.598065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.598403 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.598725 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.599053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.599366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.599783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.600170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.600352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.600689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.601037 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.601368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.601701 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.602024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.602419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.602666 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.602983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.603310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.603706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.603948 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.604262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.604575 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.604920 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.605247 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.605568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.606009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.606226 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.606565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.606874 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.607192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.607511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.607826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.608141 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.608458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.608775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.609143 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.609463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.609789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.610000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Registered counter for database nova_api Jul 27 16:35:01.610179 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.610408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.610723 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.611045 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.611358 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.611691 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.612010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.612322 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.612637 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.612974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.613291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.613605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.614053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.614374 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.614692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.615004 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.615322 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.615640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.615962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.616287 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.616598 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.617062 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.617384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.617701 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.618018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.618329 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.618642 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.618961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.619293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.619604 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.619915 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.620227 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.620557 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.620873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.621231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.621763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.622088 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.622645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.623411 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.623959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.624300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.624678 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.625050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.625394 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.625723 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.626118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.626370 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.626700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.627039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.627372 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.627690 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.628010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.628352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.628685 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.629032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.629370 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.629937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.630192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.630517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.630877 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.630974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.631250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.631559 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.631875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.632193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.632506 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.632824 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.633184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.633498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.633820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.634137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.634455 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.634770 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.635081 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.635410 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.635720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.636108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.636464 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.636704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.637059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.637373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.637534 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:01.637801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.638003 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.638313 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.638625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.638939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.639322 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.639635 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.640573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.640884 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.641255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.641574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.641916 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.642251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.642573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.642895 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.643228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.643540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.643851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.644165 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.644473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.644782 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.645119 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.645433 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.645743 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.646051 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.646361 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.646730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.647043 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.647410 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.647730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.648053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.648364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.648672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.649048 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.649361 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.649705 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.650035 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.650366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.650698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.651020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.651351 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.651670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.652029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.652358 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.652680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.653031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.653353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.653767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.654092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.654528 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.655105 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.655705 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.657082 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.657434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.657810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.658143 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.658474 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.658802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.659131 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.659456 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.659780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.660103 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.660427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.660772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.661135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.661475 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.661824 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.662154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.662484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.662810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.663134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.663508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.663834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.664151 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.664475 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.664800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.665152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.665473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.665794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.666118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.666442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.666763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.667083 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.667405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.667728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.668114 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.668412 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.668771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.669097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.669421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.669747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.670281 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.670614 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.670957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.671315 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.671807 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.671976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.672282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.672623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.672962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.673279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.673600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.673919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.674233 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.674566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.674886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.675201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.675528 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.675845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.676407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.676788 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.677145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.677511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.677849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.678242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.678561 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.678896 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.679232 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.679572 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.679904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.680254 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.680585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.680937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.681265 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.681586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.681903 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.682223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.682627 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.682969 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.683511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.684081 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.684654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.685130 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.685486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.685838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.686189 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.686538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.686876 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.687236 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.687561 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.687882 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.688208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.688527 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.688849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.689242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.689581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.689899 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.690221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.690553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.690976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.691314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.691910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.692040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.692301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.692628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.693221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.693567 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.693896 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.694053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.context [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ee659ef-ec36-43e2-848b-212ef900904c(cell1) {{(pid=124235) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 16:35:01.694240 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.694580 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.694894 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.695210 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.695521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.695851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.696168 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.696486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.696799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.697327 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.697498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.697763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.698028 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:35:01.698200 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.698379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.698692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.699005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.699321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.699627 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:35:01.699789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.699949 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.700249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.700454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:35:01.700696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.700931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.701270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.701610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.701958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.702284 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.702455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:35:01.703135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.703487 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.703813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.704133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.704477 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.704841 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.705008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Registered counter for database nova_cell0 Jul 27 16:35:01.705208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.705546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.706024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.706346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.706695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.707048 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.707427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.707756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.708089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.708408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.708738 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.709016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Registered counter for database nova_cell1 Jul 27 16:35:01.709177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.709407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.709756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.710102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.710433 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.710746 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.711061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.711636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.711955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.712318 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.712638 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.713007 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.713345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.713672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.713980 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.714395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.714726 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.715273 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.715848 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.716421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.716736 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.717106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.717657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.717657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.718112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.718919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.719237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.719446 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.719604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.719771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.720076 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.720388 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.720723 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.721132 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.721502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.721850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.722214 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.722538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.722875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.723198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.723531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.723868 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.724195 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.724515 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.724649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:01.724856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.725201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.725518 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.725838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.726178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.726520 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.726858 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.727224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.727323 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:01.727582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.727905 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.728236 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.728563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.728910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.729237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.729562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.729902 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.730219 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.730538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.730853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.731168 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.731484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.731806 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.732135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.732442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.732764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.733110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.733444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.733780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.734118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.734454 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.734790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.735149 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.735468 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.735822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.736160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.736482 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.736802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.737140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:35:01.737391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:35:01.801970 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO dbcounter [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Registered counter for database nova_api Jul 27 16:35:01.824541 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_db.sqlalchemy.engines [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.831624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writer thread running {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:01.873475 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO dbcounter [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Registered counter for database nova_cell0 Jul 27 16:35:01.882032 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_db.sqlalchemy.engines [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.886420 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writer thread running {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:01.891161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.context [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ee659ef-ec36-43e2-848b-212ef900904c(cell1) {{(pid=124236) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 16:35:01.895379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:35:01.897067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:35:01.897866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:35:01.899872 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:35:01.901899 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO dbcounter [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Registered counter for database nova_cell0 Jul 27 16:35:01.905973 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO dbcounter [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Registered counter for database nova_cell1 Jul 27 16:35:01.913275 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_db.sqlalchemy.engines [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.914632 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_db.sqlalchemy.engines [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:01.921578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writer thread running {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:01.922832 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writer thread running {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:02.072908 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO dbcounter [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Registered counter for database nova_cell0 Jul 27 16:35:02.081009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_db.sqlalchemy.engines [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:35:02.085540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writer thread running {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:35:02.208060 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:35:02.215598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:35:02.431997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: WARNING keystonemiddleware.auth_token [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:35:02.440552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: WARNING keystonemiddleware.auth_token [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:35:02.554647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:35:02.560647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: WARNING keystonemiddleware.auth_token [None req-cc05b2bf-a589-4c23-bd75-46b19acf12cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:35:02.566746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55981a12b9c0 pid: 124235 (default app) Jul 27 16:35:02.792905 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: WARNING keystonemiddleware.auth_token [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 16:35:02.800734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: WARNING keystonemiddleware.auth_token [None req-03c5dd17-7670-4c1d-b234-a59d6a19df42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 16:35:02.806600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55981a12b9c0 pid: 124236 (default app) Jul 27 16:35:46.889009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cd1fd685-ce1f-4012-bb84-5a6ea737d379 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e4e9820>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:46.930024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.931594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.934225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.935798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:47.520821 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cd1fd685-ce1f-4012-bb84-5a6ea737d379 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/373a6f55-711c-470c-a175-585502cf4c33" status: 200 len: 351 microversion: 2.1 time: 1.054717 Jul 27 16:35:47.522303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 1/1] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:35:46 2022] GET /compute/v2.1/os-volumes/373a6f55-711c-470c-a175-585502cf4c33 => generated 351 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:49.522529 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:49.524093 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:49.529388 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:49.531099 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:49.917455 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c3c06a9d-9d29-4119-9a2d-4ca759751c69 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e3fd9d0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:50.457735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c3c06a9d-9d29-4119-9a2d-4ca759751c69 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/d729e7a0-da27-4ea6-8226-5fde06345825" status: 200 len: 351 microversion: 2.1 time: 0.941783 Jul 27 16:35:50.458585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 1/2] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:35:49 2022] GET /compute/v2.1/os-volumes/d729e7a0-da27-4ea6-8226-5fde06345825 => generated 351 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:53.548345 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1829258176", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "networks": [{"uuid": "7942e80d-cb37-4e51-832b-051e74cf2da3"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:35:53.760954 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] validate_networks() for [('7942e80d-cb37-4e51-832b-051e74cf2da3', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:35:54.551251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dcf1111c-c5be-4edf-a36e-31729b768c13 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e2c0af0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:54.695670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dcf1111c-c5be-4edf-a36e-31729b768c13 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/74ab6531-edd1-45d8-b3c1-bed7e357a63f" status: 200 len: 351 microversion: 2.1 time: 0.153422 Jul 27 16:35:54.696960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:35:54 2022] GET /compute/v2.1/os-volumes/74ab6531-edd1-45d8-b3c1-bed7e357a63f => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:54.716429 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-217f26b3-33c9-4181-866f-c782d908b6a4 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e2811f0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:54.997953 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-217f26b3-33c9-4181-866f-c782d908b6a4 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.291562 Jul 27 16:35:54.999156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 3/4] 10.222.0.74 () {58 vars in 1134 bytes} [Wed Jul 27 16:35:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:35:55.013933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a1b6a35b-cc7a-4b0b-9941-6947b18f2aea tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e2c0b80>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:55.234937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a1b6a35b-cc7a-4b0b-9941-6947b18f2aea tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.225446 Jul 27 16:35:55.235813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 4/5] 10.222.0.74 () {58 vars in 1149 bytes} [Wed Jul 27 16:35:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:55.251405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-980f0702-ab68-4769-bf1d-affd6266c7d3 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e297af0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:55.418359 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-980f0702-ab68-4769-bf1d-affd6266c7d3 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.172114 Jul 27 16:35:55.419562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 5/6] 10.222.0.74 () {58 vars in 1134 bytes} [Wed Jul 27 16:35:55 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:35:55.444204 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4652acf2-9878-484f-ac74-c7cfa51dd229 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e4e49d0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:55.625919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4652acf2-9878-484f-ac74-c7cfa51dd229 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.186194 Jul 27 16:35:55.626534 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 6/7] 10.222.0.74 () {58 vars in 1167 bytes} [Wed Jul 27 16:35:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:55.640500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-04c44a11-274d-42b4-ab3a-94da510d912c tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e29c670>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:55.786932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-04c44a11-274d-42b4-ab3a-94da510d912c tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.150858 Jul 27 16:35:55.788365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 7/8] 10.222.0.74 () {58 vars in 1170 bytes} [Wed Jul 27 16:35:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:55.801756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6a518025-8715-49a9-ab2d-4bf88bc1f8dc tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e29d8b0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:55.976299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6a518025-8715-49a9-ab2d-4bf88bc1f8dc tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.178395 Jul 27 16:35:55.981414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 8/9] 10.222.0.74 () {58 vars in 1155 bytes} [Wed Jul 27 16:35:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:35:56.001043 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-51d1eafa-14a6-48f6-bd16-2534044b1439 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e29c0d0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:56.197829 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-51d1eafa-14a6-48f6-bd16-2534044b1439 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.206939 Jul 27 16:35:56.199123 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 9/10] 10.222.0.74 () {58 vars in 1188 bytes} [Wed Jul 27 16:35:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:35:56.213180 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f20e1cb5-1b46-4ef6-a772-e7323c5b7d36 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] Calling method '.version_select at 0x7ff56e2c0c10>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:56.459029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f20e1cb5-1b46-4ef6-a772-e7323c5b7d36 tempest-VolumesTestJSON-407361239 tempest-VolumesTestJSON-407361239-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.250556 Jul 27 16:35:56.459823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 10/11] 10.222.0.74 () {58 vars in 1155 bytes} [Wed Jul 27 16:35:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:35:57.771263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:35:57.772026 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:35:57.772132 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:35:57.772541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:35:57.772971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:35:57.821975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:35:57.822426 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:35:57.823217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:35:57.823644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:35:57.932217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Getting quotas for project 9f922d21e1e8434ea5e93938dc56bed9. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:35:57.955428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Getting quotas for user c5710d1f3a6742e489c7c676cc4c01d3 and project 9f922d21e1e8434ea5e93938dc56bed9. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:35:57.992385 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:35:57.997909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:35:58.193461 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6ff9a7f1-373f-4a66-b756-c15e59b9eb21 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.794640 Jul 27 16:35:58.202336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 2/12] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:35:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:35:58.206720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9bc22aeb-bad9-43ad-bb02-d42858608cc0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:58.208047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9bc22aeb-bad9-43ad-bb02-d42858608cc0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:35:58.650794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9bc22aeb-bad9-43ad-bb02-d42858608cc0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:35:58.674480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9bc22aeb-bad9-43ad-bb02-d42858608cc0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1215 microversion: 2.1 time: 0.471477 Jul 27 16:35:58.687157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 11/13] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:35:58 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1215 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:35:59.698790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-34fdb6ca-95d0-4ac0-b010-1849edb71d01 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:35:59.700052 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-34fdb6ca-95d0-4ac0-b010-1849edb71d01 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:35:59.933925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-34fdb6ca-95d0-4ac0-b010-1849edb71d01 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:35:59.980619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-34fdb6ca-95d0-4ac0-b010-1849edb71d01 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1215 microversion: 2.1 time: 0.283706 Jul 27 16:35:59.983696 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 3/14] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:35:59 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:01.012148 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:01.012958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:01.038050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:01.048328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:01.050002 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:01.053307 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:01.426941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:01.465002 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a79c9a76-0d9e-4385-9389-527502f4f90a tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1267 microversion: 2.1 time: 0.462620 Jul 27 16:36:01.467744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 12/15] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:01 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1267 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:02.488191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:02.489592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:02.507028 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:02.507878 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:02.509126 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:02.515045 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:02.541785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-212d0a3c-4ffc-429a-afc6-c97f8b2dbf0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'create', calling method: .version_select at 0x7ff56d999ca0>, body: {"keypair": {"name": "tempest-keypair-749446176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENcTBVA0llVBSyKQuGvkVy5C01yFnBmu+2OzYoKTAStfIpTr5+jDJKd1hnJXv8o8C93xhX/uBwUhhLz/BCJNDobheyNG2EJW0vZbzHadxdKCrOsc19O0vTA3a2FOJ3VKg=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:02.608704 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-212d0a3c-4ffc-429a-afc6-c97f8b2dbf0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for project 8d570044769a44d9b18c905284cd9947. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:02.617978 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-212d0a3c-4ffc-429a-afc6-c97f8b2dbf0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for user 22bb7775bae64374b11462a53853e54f and project 8d570044769a44d9b18c905284cd9947. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:02.723573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-212d0a3c-4ffc-429a-afc6-c97f8b2dbf0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.527135 Jul 27 16:36:02.727889 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 4/16] 10.222.0.74 () {62 vars in 1200 bytes} [Wed Jul 27 16:36:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 532 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 16:36:02.913357 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:02.930296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b44f3850-2354-4d75-828a-ac5fec477d35 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1273 microversion: 2.1 time: 0.444449 Jul 27 16:36:02.931803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 13/17] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:02 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:03.879055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-363bdad2-1dc6-4e68-8451-afd36a799c2a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: .version_select at 0x7ff56d151e50>, body: {"keypair": {"name": "tempest-keypair-1599923766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9BXA3fD6ygloOW7KFdcAjOVw7jtHNyQ+xXbKt9y3DYyHNrEQanoS9tGbR9TsGOahsubIiTG6FAZKAjCe+HapxbHyxXFHxEgGsQjsWo2fKbjExgBk92QRA2zrDU0Nnf/g=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:03.937921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-363bdad2-1dc6-4e68-8451-afd36a799c2a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:03.947899 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-363bdad2-1dc6-4e68-8451-afd36a799c2a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:03.965234 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:03.966689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:03.979535 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:03.980679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:03.985399 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:03.986817 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:04.094713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-363bdad2-1dc6-4e68-8451-afd36a799c2a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.385048 Jul 27 16:36:04.095685 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 5/18] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:36:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:04.672476 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:04.686147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5049f049-8eb5-4ba1-9975-c34092154092 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1273 microversion: 2.1 time: 0.724660 Jul 27 16:36:04.691887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 14/19] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:03 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1273 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:05.414812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a34b8542-7231-4b0f-91cc-3918cc062c40 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: .version_select at 0x7ff56c8fb1f0>, body: {"keypair": {"name": "tempest-keypair-1364840970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzF96zTowIvIfkFi9EMXTw0fAb9cdkb/RW28JmkGD1ByDvjJcIOl6zYeUdG3xcJjL+Vlf0/up3AdWbSRpKiWT4018JQpDFgvbYVi3wRQVOzML0trGTp1WtWZStXqxS9KA=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:05.472091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-a34b8542-7231-4b0f-91cc-3918cc062c40 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for project 89ddf8711f2f4be88304f967149c3a50. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:05.486440 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-a34b8542-7231-4b0f-91cc-3918cc062c40 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for user 7a0bd78165c94d9e9750fe4af4f7d375 and project 89ddf8711f2f4be88304f967149c3a50. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:05.574309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a34b8542-7231-4b0f-91cc-3918cc062c40 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.768966 Jul 27 16:36:05.579693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 6/20] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:36:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:05.714691 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:05.716481 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:05.739156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:05.739850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:05.742480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:05.743398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:07.733680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:07.741927 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-44544c70-6ca2-4e5c-956f-afdc2958da4f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 2.032454 Jul 27 16:36:07.760157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 15/21] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:05 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:08.783790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:08.785046 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:08.789548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:08.790179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:08.832813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:08.833390 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:08.834105 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:08.834729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:09.291117 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:09.721480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-673105639", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:09.866309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:09.898704 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8cb12be0-f1bf-4660-a091-b56f936e4111 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 1.113621 Jul 27 16:36:09.899509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 7/22] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:08 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:10.026069 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] validate_networks() for [('d36a590e-5aca-4f4b-84ba-ed6272112a6f', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:36:10.925590 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:10.926222 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:10.943502 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:10.944025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:10.957263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:10.957977 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:13.101607 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:13.115263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-07f07822-4cf6-4003-8ade-25a27aee6107 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 2.192709 Jul 27 16:36:13.115263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 8/23] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:10 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:13.313559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-42c9d673-bc8f-4053-bb33-319f971bf4b5 req-f854dc54-e832-4d1b-be74-b4e807b74139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a55b7c3-0254-4b12-a47b-357fa5db50a9", "tag": "37e635ad-37c3-43df-90e3-5c0a40020c13"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:13.355368 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-42c9d673-bc8f-4053-bb33-319f971bf4b5 req-f854dc54-e832-4d1b-be74-b4e807b74139 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:13.364288 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-42c9d673-bc8f-4053-bb33-319f971bf4b5 req-f854dc54-e832-4d1b-be74-b4e807b74139 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:13.425462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-42c9d673-bc8f-4053-bb33-319f971bf4b5 req-f854dc54-e832-4d1b-be74-b4e807b74139 service nova] Creating event network-changed:37e635ad-37c3-43df-90e3-5c0a40020c13 for instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 on hv-cinder-84969 Jul 27 16:36:13.431012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-42c9d673-bc8f-4053-bb33-319f971bf4b5 req-f854dc54-e832-4d1b-be74-b4e807b74139 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 16:36:13.438727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:13.438727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:13.450009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:13.450809 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:13.488190 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.compute.rpcapi [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 16:36:13.519231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 16:36:13.577190 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-69ed8d75-bb0b-4b84-a3cd-d7c3f97a01a7 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441307 Jul 27 16:36:13.578134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 9/24] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:13.791160 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-243357548", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b2b545b-e176-40e2-8391-7dafbc2122d9"}], "security_groups": [{"name": "tempest-securitygroup--1113327231"}], "key_name": "tempest-keypair-749446176", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:14.216417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] validate_networks() for [('4b2b545b-e176-40e2-8391-7dafbc2122d9', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:36:14.309979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:36:14.311047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:36:14.311589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:36:14.312060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:36:14.312627 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:36:14.343697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:14.344140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:14.344946 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:14.345380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:14.423282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for project 027a003da80c43ca9b4b337527b93d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:14.434078 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for user 1c0838069cba4d1389ec6fc809db70a7 and project 027a003da80c43ca9b4b337527b93d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:14.453859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:36:14.458006 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:36:14.569436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b182416a-58a9-4bbd-b54b-6f2b586a404f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.283729 Jul 27 16:36:14.570112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 16/25] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:36:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 5286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 16:36:14.585130 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:14.585774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:14.604463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:14.605510 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:14.608801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:14.608801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:15.313713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:15.329220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0e2162e2-ab30-44a2-bb3c-1717481841f3 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.755223 Jul 27 16:36:15.331642 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 17/26] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:14 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:15.340824 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1476961179", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22edebd8-fe29-44cb-9c58-64fe5ac1da5e"}], "security_groups": [{"name": "tempest-securitygroup--1100778192"}], "key_name": "tempest-keypair-1599923766", "user_data": "}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:15.492919 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:36:15.493577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:36:15.493929 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:36:15.494403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:36:15.494877 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:36:15.511932 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:15.512771 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:15.514020 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:15.519867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:15.573282 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for project 8d570044769a44d9b18c905284cd9947. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:15.584655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for user 22bb7775bae64374b11462a53853e54f and project 8d570044769a44d9b18c905284cd9947. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:15.617375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:36:15.632990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:36:15.706444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ba99cfe8-96c1-4892-b21a-99689f6ecd8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.934557 Jul 27 16:36:15.707587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 10/27] 10.222.0.74 () {62 vars in 1188 bytes} [Wed Jul 27 16:36:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 16:36:15.713636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1b25b2e4-4ccf-4b6d-b075-dabf185ba76f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:15.714404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1b25b2e4-4ccf-4b6d-b075-dabf185ba76f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:15.907133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] validate_networks() for [('22edebd8-fe29-44cb-9c58-64fe5ac1da5e', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:36:15.919076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1b25b2e4-4ccf-4b6d-b075-dabf185ba76f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:15.934752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1b25b2e4-4ccf-4b6d-b075-dabf185ba76f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1221 microversion: 2.1 time: 0.221704 Jul 27 16:36:15.935404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 11/28] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:15 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:15.965684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-04fbcccb-75d7-4638-85c0-07dcf5756e0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:15.967832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-04fbcccb-75d7-4638-85c0-07dcf5756e0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:16.483290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-04fbcccb-75d7-4638-85c0-07dcf5756e0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:16.507971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-04fbcccb-75d7-4638-85c0-07dcf5756e0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:16.513249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-04fbcccb-75d7-4638-85c0-07dcf5756e0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:16.515678 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-04fbcccb-75d7-4638-85c0-07dcf5756e0a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1280 microversion: 2.20 time: 0.558113 Jul 27 16:36:16.529387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 12/29] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:15 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1280 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:16.529387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-326631793", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:16.695005 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] validate_networks() for [('d36a590e-5aca-4f4b-84ba-ed6272112a6f', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:36:17.718432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:36:17.719057 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:36:17.719935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:36:17.720621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:36:17.721199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:36:17.722632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:36:17.723706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:36:17.724752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:36:17.725528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:36:17.726251 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:36:17.728514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:17.742199 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:17.742870 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:17.743829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:17.744458 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:17.747811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:17.748586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:17.749685 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:17.751108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:17.763163 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for project 027a003da80c43ca9b4b337527b93d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:17.767556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for user 1c0838069cba4d1389ec6fc809db70a7 and project 027a003da80c43ca9b4b337527b93d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:17.780239 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:36:17.782434 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:36:17.783053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:17.788130 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:17.805088 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:36:17.811919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:36:17.873704 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6619618c-40d3-4f12-98fd-8e08fc81cca1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.355631 Jul 27 16:36:17.882610 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 13/30] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:36:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:36:17.894033 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:17.896299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:17.912334 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:17.913964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:17.915367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1a320e05-8b47-45fe-90bc-5ae7796e0326 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.578080 Jul 27 16:36:17.915495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:17.915856 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:17.917052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 18/31] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:36:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:36:17.932609 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-356054415", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f30e4e1-bf07-478c-895f-f27f24b25617"}], "security_groups": [{"name": "tempest-securitygroup--1157196307"}], "key_name": "tempest-keypair-1364840970", "user_data": "}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:18.190250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] validate_networks() for [('5f30e4e1-bf07-478c-895f-f27f24b25617', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:36:18.678063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:18.709535 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7d09822a-150b-4d17-afc0-32b3e6e40b91 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.824985 Jul 27 16:36:18.720939 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 14/32] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:17 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:18.746486 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:18.756091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:18.785585 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:18.787116 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:18.788406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:18.788855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:18.985322 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:19.000123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:19.008349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:19.010483 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e4897c2a-4da7-47b6-aa34-92d5f95f6f41 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1284 microversion: 2.20 time: 0.298515 Jul 27 16:36:19.011863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 15/33] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:18 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:19.022802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:19.023619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:19.032108 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.032755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.033742 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.034617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.149147 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:19.171099 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f88263c5-6824-4d55-a03d-ae57a3d2db74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1225 microversion: 2.1 time: 0.146050 Jul 27 16:36:19.172621 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 16/34] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:19 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1225 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:19.183546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:19.184178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:19.199954 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.205580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.206653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.207252 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.332809 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:19.344321 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-23806ef3-6d7b-4ab5-89eb-2a8a9b53b82c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1246 microversion: 2.1 time: 0.167105 Jul 27 16:36:19.346943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 17/35] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:19 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1246 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:19.435906 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:36:19.445932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:36:19.445932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:36:19.445932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:36:19.445932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:36:19.461330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.462492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.480747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.483106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.577194 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for project 89ddf8711f2f4be88304f967149c3a50. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:19.593190 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for user 7a0bd78165c94d9e9750fe4af4f7d375 and project 89ddf8711f2f4be88304f967149c3a50. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:19.622981 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:36:19.627292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:36:19.736391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c7259ecf-562b-4950-a05a-b016cca79bb4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.811618 Jul 27 16:36:19.740018 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:19.741431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 19/36] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:36:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:36:19.751781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:19.757161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-74387dce-6b06-4298-9c42-c3c9cfa6da48 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:19.761084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-74387dce-6b06-4298-9c42-c3c9cfa6da48 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:19.784584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.785086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:19.813934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:19.836593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.025848 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-74387dce-6b06-4298-9c42-c3c9cfa6da48 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:20.040779 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-74387dce-6b06-4298-9c42-c3c9cfa6da48 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1237 microversion: 2.1 time: 0.295735 Jul 27 16:36:20.045208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 20/37] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:19 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1237 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:20.054242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:20.055171 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:20.058811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=9 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:20.075407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:20.077516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.080434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:20.081762 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.553761 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:20.569380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:20.574792 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:20.578713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-233de6d4-0a36-4c52-b35c-ae10658ed1b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1284 microversion: 2.20 time: 0.531654 Jul 27 16:36:20.580819 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 21/38] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:20 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1284 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:20.596863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:20.598790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:20.607146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:20.608413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.609647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:20.610462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.651907 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:20.666577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c5e5f89e-9e87-47bb-a793-0a972ef53b83 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.934259 Jul 27 16:36:20.672039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 18/39] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:19 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:20.686394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:20.698029 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:20.733183 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:20.737582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.744544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:20.745329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:20.806312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:20.818262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-829626ec-58e1-46c9-9bdd-de560f6f0a3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1217 microversion: 2.1 time: 0.234725 Jul 27 16:36:20.822054 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 22/40] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:20 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:20.985873 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:21.004033 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-06dd4cdb-64d6-4166-8bca-541cae746a57 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1238 microversion: 2.1 time: 0.328927 Jul 27 16:36:21.007471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 19/41] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:20 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1238 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:21.064735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b91fbb3b-32a8-416a-a54f-8d7cb9c1584b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:21.066201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b91fbb3b-32a8-416a-a54f-8d7cb9c1584b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:21.256756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b91fbb3b-32a8-416a-a54f-8d7cb9c1584b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:21.277931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b91fbb3b-32a8-416a-a54f-8d7cb9c1584b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1237 microversion: 2.1 time: 0.219875 Jul 27 16:36:21.281279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 23/42] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:21 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1237 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:21.609005 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:21.609930 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:21.626172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:21.627260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:21.629160 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:21.631112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:21.694803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:21.696147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:21.714306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:21.714306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:21.714306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:21.714306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:21.807227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:21.816196 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:21.820266 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:21.821464 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dfe18c4e-4b50-4636-9467-c3e0c7c70400 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1332 microversion: 2.20 time: 0.218031 Jul 27 16:36:21.839834 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 20/43] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:21 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:21.852279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:21.854788 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:21.869599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:21.870434 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:21.871536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:21.872331 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.028507 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:22.041533 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cc676ab2-6dbd-4a29-a16a-9eb20803f85b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1273 microversion: 2.1 time: 0.195902 Jul 27 16:36:22.053884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 21/44] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:21 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:22.070719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:22.072494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:22.093892 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:22.095348 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.099158 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:22.101314 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.145461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:22.160162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a6295516-1a00-4f5f-8cac-3abba3c8becb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.469003 Jul 27 16:36:22.182349 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 24/45] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:21 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:22.307670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:22.309293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:22.348197 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:22.349940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.350970 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:22.355060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.579769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:22.588445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e6d76dac-da7f-4e0b-bd40-c33257ef93f2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1241 microversion: 2.1 time: 0.288319 Jul 27 16:36:22.593935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 25/46] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:22 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1241 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:22.600971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:22.613119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-af23b740-ae60-4e4d-bd15-e51ddf94cb16 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1294 microversion: 2.1 time: 0.557041 Jul 27 16:36:22.614036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 22/47] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:22 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1294 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:22.844934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:22.846344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:22.856399 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:22.856844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.861436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:22.861941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:22.991193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.010306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.012666 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.014064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f07c0437-3f91-4030-98b1-03f06e67d5bb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1340 microversion: 2.20 time: 0.174104 Jul 27 16:36:23.014792 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 26/48] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:22 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1340 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:23.065454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:23.067483 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:23.074158 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.074813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.075750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.076422 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.156409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.167204 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff95d78d-eae0-447e-830d-9080024434ad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1273 microversion: 2.1 time: 0.105574 Jul 27 16:36:23.170450 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 23/49] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:23 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:23.190057 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:23.190979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:23.206294 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.207436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.208692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.209177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.365297 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.373367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8fab7bb6-0887-4aff-ab4e-bf2f9518745e tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.187992 Jul 27 16:36:23.374024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 27/50] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:23 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:23.617789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:23.618410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:23.628490 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.630509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.631233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.631672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.640303 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:23.641272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:23.655591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.657133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.658641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:23.659904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:23.763877 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.771365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c3002ed8-67a6-4f7f-a4da-d0b7308bf735 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1294 microversion: 2.1 time: 0.135979 Jul 27 16:36:23.776942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 28/51] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:23 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:23.798652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:23.812194 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0f8779ec-0d56-45a6-9666-fcf057212976 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1233 microversion: 2.1 time: 0.197503 Jul 27 16:36:23.829083 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 24/52] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:23 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1233 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:24.039521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:24.040651 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:24.051255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.054229 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.055482 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.058606 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.195955 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:24.199455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:24.207987 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.208593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.209398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.210284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.575138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:24.585240 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2cc07686-d27e-4e6d-af3b-8844791c88f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1291 microversion: 2.1 time: 0.397851 Jul 27 16:36:24.585815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 25/53] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:24 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1291 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:24.604222 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:24.605814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:24.616025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.616764 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.617871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.618773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:24.622112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.631890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:24.638020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:24.639560 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8834bcba-b1c1-4fc0-86cb-0b0dbcd47899 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1350 microversion: 2.20 time: 0.605200 Jul 27 16:36:24.653853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 29/54] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:24 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1350 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:24.794001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:24.794634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:24.802870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.803610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.805697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.806311 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.902327 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:24.912237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e88f55bc-4c73-4105-b0dd-a58cf0290a25 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1302 microversion: 2.1 time: 0.122093 Jul 27 16:36:24.913511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 30/55] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:24 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:24.919155 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:24.920742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:24.927185 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.927713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.928680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:24.929398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:24.966376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:24.976211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9f281f01-8bdb-4a79-8ff8-73d6b5a68081 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.376483 Jul 27 16:36:24.977022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 26/56] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:24 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:25.016184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:25.024913 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ca433a8f-eff3-4c54-a394-188eb6105153 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1289 microversion: 2.1 time: 0.109767 Jul 27 16:36:25.025751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 31/57] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:24 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:25.607662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:25.608289 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:25.624728 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:25.625204 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:25.628145 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:25.628583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:25.639750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:25.665434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:25.666056 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:25.692972 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:25.693430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:25.694203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:25.694636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:25.763485 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:25.799278 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:25.812520 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d8ae893b-504d-4f41-ac5e-5cc85ba4159b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1279 microversion: 2.1 time: 0.206127 Jul 27 16:36:25.816924 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 27/58] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:25 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:25.934792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:25.937145 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:25.947380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:25.955846 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:25.956954 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:25.957571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:25.968192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:25.982218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:25.984154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:25.994224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ca487b85-5f66-449b-b637-4ad8bbfc6931 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1338 microversion: 2.20 time: 0.334131 Jul 27 16:36:25.995085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 32/59] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:25 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1338 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:26.000317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:26.016188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:26.049728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:26.051883 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:26.061755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:26.063793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:26.273301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:26.303723 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ea9da877-a30f-4f32-b5a7-6f2fe687aeef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1300 microversion: 2.1 time: 0.372922 Jul 27 16:36:26.304950 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 28/60] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:25 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1300 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:26.318576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:26.322097 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:26.342961 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:26.344986 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:26.347935 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:26.348630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:26.604840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:26.618033 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4d81c57d-5c58-4e4a-99c1-c6bcd1e5f20e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1295 microversion: 2.1 time: 0.310308 Jul 27 16:36:26.640326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 29/61] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:26 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1295 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:26.715974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:26.732924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-19ba4012-e546-4b07-9d78-38cf0f7502a5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.736027 Jul 27 16:36:26.734837 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 33/62] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:25 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:26.841399 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:26.842577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:26.851568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:26.852367 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:26.853727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:26.854975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:26.984825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:27.006306 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c59ded42-4d05-4509-bf95-9eed7afe4127 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1279 microversion: 2.1 time: 0.174701 Jul 27 16:36:27.006895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 30/63] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:26 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:27.020068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:27.020808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:27.027926 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.028532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.030965 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.031410 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.189166 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:27.203116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:27.204800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:27.205944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-260567bf-2cbc-421e-8aff-804af55707fb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1338 microversion: 2.20 time: 0.190870 Jul 27 16:36:27.206508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 34/64] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:27 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:27.325397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:27.326082 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:27.333255 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.334777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.335720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.336299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.646724 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:27.647517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:27.657413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.658090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.659011 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.665599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.755122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:27.777530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=36 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:27.875530 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:27.886193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c44ae814-4129-40d1-98d3-3930d8232205 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1295 microversion: 2.1 time: 0.243715 Jul 27 16:36:27.892488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 35/65] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:27 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1295 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:27.911504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:27.912476 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:27.919281 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.919860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:27.920729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:27.921279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.155242 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.163375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e34f5293-14a5-4dd8-8224-e38726e42960 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.841882 Jul 27 16:36:28.175225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 31/66] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:27 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:28.175225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:28.175225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:28.183029 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.183752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.186270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.186895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.262187 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.271840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-66457618-4b8e-4b79-b03c-c408d542da55 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.365345 Jul 27 16:36:28.272690 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 36/67] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:27 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:28.287265 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:28.289147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:28.297786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.298359 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.299130 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.299602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.539464 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.548455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5ced58db-b358-4194-abdb-a202c5979c3b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.383501 Jul 27 16:36:28.549181 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 32/68] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:28 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:28.561688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.581345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.582870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.584026 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-54157005-deae-428b-841a-69df85222f2b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.310086 Jul 27 16:36:28.584577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 37/69] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:28 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:28.637325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-ea68b2cb-de15-4fc8-ba9c-cb87d0a774c8 req-39541700-58f3-47a3-be9c-c5b825448c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c4add4-825e-428a-b0ba-a2f6447d80a7", "tag": "ee2f2c0f-c666-48ff-8555-4ac295050a28"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:28.647530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ea68b2cb-de15-4fc8-ba9c-cb87d0a774c8 req-39541700-58f3-47a3-be9c-c5b825448c8b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.647976 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ea68b2cb-de15-4fc8-ba9c-cb87d0a774c8 req-39541700-58f3-47a3-be9c-c5b825448c8b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.671404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-ea68b2cb-de15-4fc8-ba9c-cb87d0a774c8 req-39541700-58f3-47a3-be9c-c5b825448c8b service nova] Creating event network-changed:ee2f2c0f-c666-48ff-8555-4ac295050a28 for instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 on hv-cinder-84969 Jul 27 16:36:28.683268 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-ea68b2cb-de15-4fc8-ba9c-cb87d0a774c8 req-39541700-58f3-47a3-be9c-c5b825448c8b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132602 Jul 27 16:36:28.683919 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 33/70] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:28.916180 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:28.916879 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:28.923599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.924198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.924797 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:28.925269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:28.988884 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:28.996228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6710ce33-7abf-4d62-a3f0-79b80301f54d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1295 microversion: 2.1 time: 0.084474 Jul 27 16:36:28.996785 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 38/71] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:28 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:29.186087 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:29.186815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:29.193165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.193621 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.194380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.194817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.296513 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:29.297454 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:29.305708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.308503 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.310354 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.310954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.503835 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=6 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:29.818720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:29.827928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8e3a71d0-8393-4fed-b5e5-dc8365fc94c9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.646077 Jul 27 16:36:29.842063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 34/72] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:29 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:29.847172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:29.847954 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:29.861405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.861984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.862882 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.864341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.902837 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:29.912128 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d41fd978-5cb8-41ff-9769-f44b5be2f0e5 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.622354 Jul 27 16:36:29.937222 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 39/73] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:29 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:29.942762 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:29.943647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:29.957353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.957962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:29.958976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:29.959554 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.269444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=22 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:31.271115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:31.285518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-75b8dd18-5571-4569-a944-329992ceb03d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 1.442029 Jul 27 16:36:31.286462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 35/74] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:29 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:31.291172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:31.300999 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:31.308431 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.309124 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.310826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.314697 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.327300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:31.345179 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:31.347780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:31.349473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d8eca526-fec7-47c0-aac3-c02cd08dfbec tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 1.410356 Jul 27 16:36:31.366485 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 40/75] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:29 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:31.373381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-c17f82e3-3054-4314-8ac7-7f272046986f req-68413bbd-4338-458b-9ba2-edb18e646246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7fb7d3a-2581-4c62-9d19-7636961df56e", "tag": "78e696af-c295-41c4-a3bd-e88439dd705f"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:31.392012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-c17f82e3-3054-4314-8ac7-7f272046986f req-68413bbd-4338-458b-9ba2-edb18e646246 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.393095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-c17f82e3-3054-4314-8ac7-7f272046986f req-68413bbd-4338-458b-9ba2-edb18e646246 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.443029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-c17f82e3-3054-4314-8ac7-7f272046986f req-68413bbd-4338-458b-9ba2-edb18e646246 service nova] Creating event network-changed:78e696af-c295-41c4-a3bd-e88439dd705f for instance c7fb7d3a-2581-4c62-9d19-7636961df56e on hv-cinder-84969 Jul 27 16:36:31.444081 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-c17f82e3-3054-4314-8ac7-7f272046986f req-68413bbd-4338-458b-9ba2-edb18e646246 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 16:36:31.445567 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.446341 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.447587 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.448235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.484708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.compute.rpcapi [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 16:36:31.485684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] Releasing lock "compute-rpcapi-router" {{(pid=124236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 16:36:31.514367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2634c661-d08c-4c12-bdea-c933522963fe None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145471 Jul 27 16:36:31.515242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 41/76] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:31.521646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:31.522966 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:31.531837 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.532815 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.533829 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.534696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.702545 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:31.714101 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-826d1478-1788-43b1-8a56-3d4dba902ff8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1295 microversion: 2.1 time: 0.426609 Jul 27 16:36:31.714677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 36/77] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:31 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1295 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:31.733537 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:31.734120 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:31.741461 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.742109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:31.743746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:31.744327 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.302993 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:32.305997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:32.313202 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5decde2-d215-4409-8e12-1549013c751f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.586872 Jul 27 16:36:32.313801 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 37/78] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:31 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:32.317850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-332cc194-0d9c-481c-a289-c3a0f3f18a23 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.801135 Jul 27 16:36:32.318469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 42/79] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:31 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:32.324420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:32.325797 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:32.334362 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.335179 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.337869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.338966 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.428765 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-8827ab69-44a1-4149-a835-8c8a5508f71b req-89dc35a7-ebb8-4ff7-86b0-dadfd5af0754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a55b7c3-0254-4b12-a47b-357fa5db50a9", "name": "network-vif-plugged", "status": "completed", "tag": "37e635ad-37c3-43df-90e3-5c0a40020c13"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:32.441432 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-8827ab69-44a1-4149-a835-8c8a5508f71b req-89dc35a7-ebb8-4ff7-86b0-dadfd5af0754 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.441885 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-8827ab69-44a1-4149-a835-8c8a5508f71b req-89dc35a7-ebb8-4ff7-86b0-dadfd5af0754 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.471897 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-8827ab69-44a1-4149-a835-8c8a5508f71b req-89dc35a7-ebb8-4ff7-86b0-dadfd5af0754 service nova] Creating event network-vif-plugged:37e635ad-37c3-43df-90e3-5c0a40020c13 for instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 on hv-cinder-84969 Jul 27 16:36:32.481104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-8827ab69-44a1-4149-a835-8c8a5508f71b req-89dc35a7-ebb8-4ff7-86b0-dadfd5af0754 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148834 Jul 27 16:36:32.482824 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 38/80] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:32.492667 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:32.493415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:32.504147 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.505717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.506768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.507354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.740679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:32.756343 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-907f895a-3513-4ffa-b8ad-fb88b84422b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.435511 Jul 27 16:36:32.765442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 43/81] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:32 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:32.774173 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-7ebee396-9f9f-42db-b93e-9deb044c8c41 req-1301ead6-d753-44ee-a629-df1323005a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdc21ff-3230-4793-bfe7-b12d4ea18cf2", "tag": "9368fc6a-10b9-4455-a76f-7ab085d78bdc"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:32.795857 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-7ebee396-9f9f-42db-b93e-9deb044c8c41 req-1301ead6-d753-44ee-a629-df1323005a2c service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.796592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-7ebee396-9f9f-42db-b93e-9deb044c8c41 req-1301ead6-d753-44ee-a629-df1323005a2c service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.819813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-7ebee396-9f9f-42db-b93e-9deb044c8c41 req-1301ead6-d753-44ee-a629-df1323005a2c service nova] Creating event network-changed:9368fc6a-10b9-4455-a76f-7ab085d78bdc for instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 on hv-cinder-84969 Jul 27 16:36:32.852112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-7ebee396-9f9f-42db-b93e-9deb044c8c41 req-1301ead6-d753-44ee-a629-df1323005a2c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063342 Jul 27 16:36:32.854987 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 44/82] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:32.866183 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:32.867378 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:32.878310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.879050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:32.880513 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:32.881279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:33.206688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:33.220371 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:33.222479 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:33.224373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c48d3ccb-44cc-4ec8-b50d-780bac5c4f91 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.739772 Jul 27 16:36:33.225701 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 39/83] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:32 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:33.318178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:33.330840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e58feb2b-25e1-4bc2-b669-423a3bc38d36 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.472304 Jul 27 16:36:33.333215 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 45/84] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:32 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:33.347510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:33.348776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:33.351606 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:33.353425 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:33.357154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:33.358310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:33.359309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:33.359887 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:33.369805 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:33.370780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:33.373502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:33.375600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.101300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:34.110992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f64c313e-c24a-432c-abaf-e84b1ac28825 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.780940 Jul 27 16:36:34.117790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 40/85] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:33 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:34.125372 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c34b6c8c-1d05-4494-ae9b-6fcea03db25c req-8561982e-0c05-442d-af50-545606ca15de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:34.158606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c34b6c8c-1d05-4494-ae9b-6fcea03db25c req-8561982e-0c05-442d-af50-545606ca15de service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.158606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c34b6c8c-1d05-4494-ae9b-6fcea03db25c req-8561982e-0c05-442d-af50-545606ca15de service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.207435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c34b6c8c-1d05-4494-ae9b-6fcea03db25c req-8561982e-0c05-442d-af50-545606ca15de service nova] Creating event network-changed:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:36:34.224275 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c34b6c8c-1d05-4494-ae9b-6fcea03db25c req-8561982e-0c05-442d-af50-545606ca15de service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105037 Jul 27 16:36:34.229123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 41/86] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:34.235080 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:34.235793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:34.262591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.267009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:34.271725 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.278438 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.281676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.285178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-52931bcd-75b6-41bb-9f0c-b9d9b4a37148 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.937979 Jul 27 16:36:34.293270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 46/87] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:33 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:34.311487 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:34.328560 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:34.341327 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.349052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.350008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.352386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.744614 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:34.761003 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-792e1c5f-2adb-4ced-b114-c2f9b579c61d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.527538 Jul 27 16:36:34.775112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 42/88] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:34 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:34.788380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:34.788800 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:34.806002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.806461 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.807533 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:34.807684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:34.900820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:34.918493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:34.923738 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:34.925418 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-de623de7-3608-4e2e-b81a-a63aed1771c9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.628381 Jul 27 16:36:34.926337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 47/89] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:34 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:35.078123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:35.101889 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e7fd434b-2853-457f-b0eb-32b1c1d9d246 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.325201 Jul 27 16:36:35.102983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 43/90] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:34 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:35.141700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:35.143932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:35.151710 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.152427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.153224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.154164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.190997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-f82c9f4f-5e7f-410e-86e0-10b659c30bbd req-fb9d76fb-30a7-458c-a6b7-3d80b13001f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0065d67-39b9-4506-a9c5-e3669abc73f3", "tag": "7d079e14-f8f7-43ce-a463-f17c326cc7bb"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:35.207893 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f82c9f4f-5e7f-410e-86e0-10b659c30bbd req-fb9d76fb-30a7-458c-a6b7-3d80b13001f8 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.208383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-f82c9f4f-5e7f-410e-86e0-10b659c30bbd req-fb9d76fb-30a7-458c-a6b7-3d80b13001f8 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.228944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-f82c9f4f-5e7f-410e-86e0-10b659c30bbd req-fb9d76fb-30a7-458c-a6b7-3d80b13001f8 service nova] Creating event network-changed:7d079e14-f8f7-43ce-a463-f17c326cc7bb for instance b0065d67-39b9-4506-a9c5-e3669abc73f3 on hv-cinder-84969 Jul 27 16:36:35.242659 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-f82c9f4f-5e7f-410e-86e0-10b659c30bbd req-fb9d76fb-30a7-458c-a6b7-3d80b13001f8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056067 Jul 27 16:36:35.243687 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 44/91] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:35.319887 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:35.320585 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:35.344753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.349799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.351783 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.353132 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.629182 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:35.636682 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0ca890f8-99ed-48a8-bada-93d4f00befde tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.502021 Jul 27 16:36:35.649164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 48/92] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:35 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:35.739775 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:35.747156 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-60fadbe5-78ce-45ed-ae1b-719597f84eda tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.431482 Jul 27 16:36:35.760739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 45/93] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:35 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:35.788679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:35.791362 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:35.813251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.815276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.817617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.818491 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.941330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1db97321-d7e4-4596-b049-f99832a4d48e req-90f90da7-dcc0-4b80-b3a2-a5a5b3eb1b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fb7d3a-2581-4c62-9d19-7636961df56e", "name": "network-vif-plugged", "status": "completed", "tag": "78e696af-c295-41c4-a3bd-e88439dd705f"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:35.964474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1db97321-d7e4-4596-b049-f99832a4d48e req-90f90da7-dcc0-4b80-b3a2-a5a5b3eb1b26 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:35.967402 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1db97321-d7e4-4596-b049-f99832a4d48e req-90f90da7-dcc0-4b80-b3a2-a5a5b3eb1b26 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:35.996514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1db97321-d7e4-4596-b049-f99832a4d48e req-90f90da7-dcc0-4b80-b3a2-a5a5b3eb1b26 service nova] Creating event network-vif-plugged:78e696af-c295-41c4-a3bd-e88439dd705f for instance c7fb7d3a-2581-4c62-9d19-7636961df56e on hv-cinder-84969 Jul 27 16:36:36.005895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1db97321-d7e4-4596-b049-f99832a4d48e req-90f90da7-dcc0-4b80-b3a2-a5a5b3eb1b26 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070178 Jul 27 16:36:36.010432 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 46/94] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:36.027054 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:36.028114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:36.051865 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.052588 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.053829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.054672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.111182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:36.617065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:36.627880 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4cc9b7cb-5979-4b65-8b0d-a968c4319ba0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.845878 Jul 27 16:36:36.637383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 49/95] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:35 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:36.646191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:36.648186 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:36.660026 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:36.673384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.673983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.674269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:36.676065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:36.676761 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.677689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d4ee2bd7-eb18-416f-ad83-1ce0cd212114 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.665832 Jul 27 16:36:36.678449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 47/96] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:36 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:36.679664 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.683539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:36.684377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:36.698088 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.698718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.699751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.700528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.712517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:36.920772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:36.921636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:36.932427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6e2358ac-371f-4c27-9110-54df2df91f1b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.290383 Jul 27 16:36:36.933160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 50/97] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:36 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:36.939438 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:36.946643 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b0e9a271-f7d8-4ab7-8a95-2ce8e4d9b604 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1315 microversion: 2.1 time: 0.266724 Jul 27 16:36:36.946968 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:36.947338 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 48/98] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:36 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:36.955211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.956252 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:36.957556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:36.958878 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.115655 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:37.124755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-45f66816-93df-40f6-ac2d-54eef6f68c99 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.190121 Jul 27 16:36:37.125703 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 51/99] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:36 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:37.650816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:37.651653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:37.658037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:37.659049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.660030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:37.660870 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.704978 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:37.706240 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:37.715484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:37.716640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.720135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:37.721846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.933174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:37.942964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-87756648-fde3-44ac-a9f4-3028e518aa3a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.295853 Jul 27 16:36:37.948724 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 49/100] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:37 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:37.953611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:37.956191 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:37.962675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:37.963378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.964601 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:37.965324 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:37.993278 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:38.017411 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:38.021973 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:38.028419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7517744a-70bb-42dd-981c-77e2949f3f1c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.330670 Jul 27 16:36:38.029821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 52/101] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:37 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:36:38.047962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:38.048616 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:38.068326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:38.068783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:38.073207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:38.073207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:38.165717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:38.188927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d9ba75a0-97cf-4e6a-a6f6-9f91e183ffcb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.238869 Jul 27 16:36:38.204879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 50/102] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:37 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:38.218856 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-87e12a32-b823-41af-a2ca-858c4f1b489c req-e3ebe878-5bee-44ca-87fd-4be629dbcc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "name": "network-vif-plugged", "status": "completed", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:38.233399 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-87e12a32-b823-41af-a2ca-858c4f1b489c req-e3ebe878-5bee-44ca-87fd-4be629dbcc49 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:38.234175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-87e12a32-b823-41af-a2ca-858c4f1b489c req-e3ebe878-5bee-44ca-87fd-4be629dbcc49 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:38.248585 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-87e12a32-b823-41af-a2ca-858c4f1b489c req-e3ebe878-5bee-44ca-87fd-4be629dbcc49 service nova] Creating event network-vif-plugged:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:36:38.255066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-87e12a32-b823-41af-a2ca-858c4f1b489c req-e3ebe878-5bee-44ca-87fd-4be629dbcc49 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040168 Jul 27 16:36:38.256453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 51/103] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:38.264424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:38.265417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:38.283768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:38.284519 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:38.285537 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:38.286125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.065116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.072685 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0c2870aa-68bf-4057-aaaf-528e507260d4 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1501 microversion: 2.1 time: 1.042029 Jul 27 16:36:39.073278 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 53/104] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:38 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1501 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:39.077890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:39.078496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:39.084422 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:39.084865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.085671 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:39.086103 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.089992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.101027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5f17fc53-659f-47e5-88af-59a23804ee72 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1368 microversion: 2.1 time: 0.842880 Jul 27 16:36:39.102402 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 52/105] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:38 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1368 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:39.110738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:39.111668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:39.136335 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:39.138216 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.139163 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:39.139600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.380719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.384859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.392284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.397398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.398604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f6e1e472-111b-4950-b624-3c65612b400b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.295162 Jul 27 16:36:39.401008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 53/106] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:39 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:39.406164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-987cccc7-e275-4857-acce-2fe3dc6e7665 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.331846 Jul 27 16:36:39.407530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:39.408397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 54/107] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:39 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:39.409164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:39.423235 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:39.423687 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.424476 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:39.425758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:39.757423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:39.767042 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-13aa2418-3e61-4b7a-8979-181584823570 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.363903 Jul 27 16:36:39.767744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 54/108] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:39 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:40.125562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:40.126385 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:40.140312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.142920 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.145256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.146629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.293722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c62d758b-6e63-4317-9bb0-0facc2156945 req-be676210-d70f-4c88-8f54-0b644861931b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c4add4-825e-428a-b0ba-a2f6447d80a7", "name": "network-vif-plugged", "status": "completed", "tag": "ee2f2c0f-c666-48ff-8555-4ac295050a28"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:40.331999 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c62d758b-6e63-4317-9bb0-0facc2156945 req-be676210-d70f-4c88-8f54-0b644861931b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.332869 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c62d758b-6e63-4317-9bb0-0facc2156945 req-be676210-d70f-4c88-8f54-0b644861931b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.352438 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c62d758b-6e63-4317-9bb0-0facc2156945 req-be676210-d70f-4c88-8f54-0b644861931b service nova] Creating event network-vif-plugged:ee2f2c0f-c666-48ff-8555-4ac295050a28 for instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 on hv-cinder-84969 Jul 27 16:36:40.359548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c62d758b-6e63-4317-9bb0-0facc2156945 req-be676210-d70f-4c88-8f54-0b644861931b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074354 Jul 27 16:36:40.360523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 55/109] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:40.429350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:40.430075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:40.436048 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:40.441031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.441491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.442279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.444750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.446575 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-504162d2-69a5-4383-b8e8-4582224f9bc9 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1558 microversion: 2.1 time: 0.324273 Jul 27 16:36:40.447250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 55/110] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:40 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1558 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:40.470900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:40.472408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:40.489843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.491018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.494035 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.495391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.787791 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:40.796235 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:40.798058 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:40.799368 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4bb4efe3-27f1-417a-a712-286806af2b6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1406 microversion: 2.20 time: 0.375699 Jul 27 16:36:40.800094 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 56/111] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:40 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:36:40.820519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:40.822043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:40.822556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:40.826417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:40.830090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-51126364-a7a5-4dfd-ae5b-5451a6bb6d1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.379688 Jul 27 16:36:40.831507 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 56/112] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:40 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:40.836201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.836871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.837676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.838369 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.849827 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:40.850648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:40.858399 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.864621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:40.865722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:40.866287 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:41.037906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9b06473a-fca8-44dd-acba-ade589ccde09 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236121 Jul 27 16:36:41.038759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 57/113] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:36:40 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:41.054022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5edf60a7-7a00-4b3b-9ab9-4ce18e08230d"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:41.057957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:41.066847 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:41.067816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:41.069368 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:41.069949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:41.077474 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:41.086151 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1155565c-ccd3-41d4-aa9a-be604eeb1aa0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.242131 Jul 27 16:36:41.101590 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 57/114] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:40 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:41.830328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:41.831641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:41.833955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:41.855672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:41.861820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:41.868057 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:41.869644 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.135965 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:42.145532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:42.148176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:42.158170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9d5f1cfa-4950-4e7d-82c4-200b525e12f0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1598 microversion: 2.20 time: 0.330596 Jul 27 16:36:42.178545 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 58/115] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:36:41 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1598 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:36:42.184605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:42.185511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:42.200248 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.201319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.202093 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.202519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.491779 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-81df463a-855e-4844-b8d3-46c6a31243aa tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "POST /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.442830 Jul 27 16:36:42.501840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 58/116] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:36:41 2022] POST /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9/os-volume_attachments => generated 194 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:42.505498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:42.507096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:42.516938 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:42.519670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-074c733c-0607-4b67-a879-b6e95329143c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.339943 Jul 27 16:36:42.521236 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 59/117] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:42 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:42.545414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:42.546128 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:42.550025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.551159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.552131 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.552724 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.562798 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.565214 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.568097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.571218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.794164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-688d211b-7a2d-4c61-8a37-149c84326025 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.269739 Jul 27 16:36:42.795085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 60/118] 10.222.0.74 () {60 vars in 1316 bytes} [Wed Jul 27 16:36:42 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:36:42.804735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-8f431aa9-9459-4fda-99cf-30b435e4f36d req-9075997f-ca4e-495f-ad66-a33ff80f321d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdc21ff-3230-4793-bfe7-b12d4ea18cf2", "name": "network-vif-plugged", "status": "completed", "tag": "9368fc6a-10b9-4455-a76f-7ab085d78bdc"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:42.806565 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:42.827480 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-87f165f5-5743-4611-9478-aa2aeed94cba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.317263 Jul 27 16:36:42.830138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 59/119] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:42 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:42.848981 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-8f431aa9-9459-4fda-99cf-30b435e4f36d req-9075997f-ca4e-495f-ad66-a33ff80f321d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:42.849522 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-8f431aa9-9459-4fda-99cf-30b435e4f36d req-9075997f-ca4e-495f-ad66-a33ff80f321d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:42.873490 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-8f431aa9-9459-4fda-99cf-30b435e4f36d req-9075997f-ca4e-495f-ad66-a33ff80f321d service nova] Creating event network-vif-plugged:9368fc6a-10b9-4455-a76f-7ab085d78bdc for instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 on hv-cinder-84969 Jul 27 16:36:42.884472 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-8f431aa9-9459-4fda-99cf-30b435e4f36d req-9075997f-ca4e-495f-ad66-a33ff80f321d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086400 Jul 27 16:36:42.888828 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 61/120] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:43.141496 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-043bfe2d-8a67-4ec1-bb0a-d09debc53658 req-eed2908c-1d59-428b-a98b-b69c46e36c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7fb7d3a-2581-4c62-9d19-7636961df56e", "tag": "78e696af-c295-41c4-a3bd-e88439dd705f"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:43.157560 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-043bfe2d-8a67-4ec1-bb0a-d09debc53658 req-eed2908c-1d59-428b-a98b-b69c46e36c01 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:43.158879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-043bfe2d-8a67-4ec1-bb0a-d09debc53658 req-eed2908c-1d59-428b-a98b-b69c46e36c01 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:43.177535 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-043bfe2d-8a67-4ec1-bb0a-d09debc53658 req-eed2908c-1d59-428b-a98b-b69c46e36c01 service nova] Creating event network-changed:78e696af-c295-41c4-a3bd-e88439dd705f for instance c7fb7d3a-2581-4c62-9d19-7636961df56e on hv-cinder-84969 Jul 27 16:36:43.188672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-043bfe2d-8a67-4ec1-bb0a-d09debc53658 req-eed2908c-1d59-428b-a98b-b69c46e36c01 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052213 Jul 27 16:36:43.190596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 60/121] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:43.548673 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:43.549681 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:43.563285 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:43.565764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:43.568870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:43.572261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:43.855351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:43.856705 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:43.874136 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:43.875586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:43.878053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:43.880250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:44.683079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:44.696251 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c637e5f7-81c9-4fd8-a767-f1262105a99e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.845286 Jul 27 16:36:44.697496 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 61/122] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:43 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:44.761444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:44.776862 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-93175add-8227-4676-84e8-3504901e700e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 1.232885 Jul 27 16:36:44.779343 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 62/123] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:43 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:45.569344 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-89e43af6-de5d-44cc-afb3-70e61927d761 req-b931db14-d9a0-4fdb-a147-d56a05585edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:45.587792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-89e43af6-de5d-44cc-afb3-70e61927d761 req-b931db14-d9a0-4fdb-a147-d56a05585edd service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:45.588495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-89e43af6-de5d-44cc-afb3-70e61927d761 req-b931db14-d9a0-4fdb-a147-d56a05585edd service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:45.612406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-89e43af6-de5d-44cc-afb3-70e61927d761 req-b931db14-d9a0-4fdb-a147-d56a05585edd service nova] Creating event network-changed:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:36:45.622308 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-89e43af6-de5d-44cc-afb3-70e61927d761 req-b931db14-d9a0-4fdb-a147-d56a05585edd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057598 Jul 27 16:36:45.628435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 62/124] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:36:45.719988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:45.720858 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:45.727384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:45.728090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:45.729073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:45.729814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:45.802066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:45.802857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:45.827876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:45.835704 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:45.836739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:45.844415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:46.195504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:46.208596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5c81c840-3ed4-48b0-8eb6-43c57f8db550 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.490117 Jul 27 16:36:46.209058 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 63/125] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:45 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:46.288155 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-7bb68abb-ccd6-44c5-a0ea-046d4d8109cc req-4db60570-ab41-48e9-84a0-256718dc5b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0065d67-39b9-4506-a9c5-e3669abc73f3", "name": "network-vif-plugged", "status": "completed", "tag": "7d079e14-f8f7-43ce-a463-f17c326cc7bb"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:46.288459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:46.302393 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-803720af-558f-433b-9555-63c6dbdec847 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1321 microversion: 2.1 time: 0.502922 Jul 27 16:36:46.305487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 63/126] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:45 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:46.306226 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-7bb68abb-ccd6-44c5-a0ea-046d4d8109cc req-4db60570-ab41-48e9-84a0-256718dc5b70 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:46.306852 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-7bb68abb-ccd6-44c5-a0ea-046d4d8109cc req-4db60570-ab41-48e9-84a0-256718dc5b70 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:46.350763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-7bb68abb-ccd6-44c5-a0ea-046d4d8109cc req-4db60570-ab41-48e9-84a0-256718dc5b70 service nova] Creating event network-vif-plugged:7d079e14-f8f7-43ce-a463-f17c326cc7bb for instance b0065d67-39b9-4506-a9c5-e3669abc73f3 on hv-cinder-84969 Jul 27 16:36:46.378321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-7bb68abb-ccd6-44c5-a0ea-046d4d8109cc req-4db60570-ab41-48e9-84a0-256718dc5b70 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091657 Jul 27 16:36:46.378968 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 64/127] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:36:47.230225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:47.232322 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:47.244693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.245176 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.245960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.246568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.327260 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:47.329133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:47.337102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.338647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.342188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.345160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.475334 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:47.485217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-777b13be-6ca3-4f9c-a45e-83c0d8829ce1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.259515 Jul 27 16:36:47.498175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 64/128] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:47 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:47.573304 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:47.582088 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-557ddd13-29e2-4853-8d20-5fe8493eb087 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1515 microversion: 2.1 time: 0.260562 Jul 27 16:36:47.582656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 65/129] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:47 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:47.612074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:47.622061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:47.640945 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.641413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.642221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.642662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.667260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:47.681198 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'flavor' on Instance uuid 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:36:47.831454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fa06d88b-ccf7-490c-941f-369a8b403b5b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2/action" status: 200 len: 32 microversion: 2.1 time: 0.227754 Jul 27 16:36:47.832054 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 65/130] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:36:47 2022] POST /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:36:47.844659 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:47.848350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:47.854488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.855065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:47.856018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:47.856613 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:48.005332 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:48.014846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fbbb1609-ec67-406b-a341-908c0422835a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.176473 Jul 27 16:36:48.015779 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 66/131] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:47 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:48.509729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:48.510607 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:48.518712 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:48.519227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:48.520224 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:48.520915 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:48.680539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:48.688068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-70a0ab62-7335-4d00-a92f-da7b9e4c41ba tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.183834 Jul 27 16:36:48.688637 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 66/132] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:48 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:49.036596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:49.037310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:49.043536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:49.044360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:49.045439 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:49.046083 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:49.195727 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:49.203729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-31f11593-cf52-4c3d-bcd2-d35165829af3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.172103 Jul 27 16:36:49.204295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 67/133] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:49 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:49.712616 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:49.714258 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:49.725242 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:49.726187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:49.727291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:49.728146 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:49.978066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:49.988098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-19e3bec2-6072-4fba-a888-266c74edb82d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.282116 Jul 27 16:36:49.988802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 67/134] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:49 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:50.234646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:50.235896 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:50.240135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=96 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:50.244648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:50.245126 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:50.247092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:50.247582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:50.272219 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:50.410624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:50.422946 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4fdc8f68-a691-4cb6-9da5-69793e415686 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.200695 Jul 27 16:36:50.424960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 68/135] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:50 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:51.011062 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:51.012742 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:51.023693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:51.024152 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:51.025068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:51.025513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:51.292104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:51.300427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c25cd8eb-735b-4ccb-be71-f8f109a97f8b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.294614 Jul 27 16:36:51.301013 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 68/136] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:51 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:51.444039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:51.444752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:51.451620 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:51.452062 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:51.452860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:51.453312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:51.596852 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:51.604450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1029645c-cc97-49da-840b-82af7418c265 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.164557 Jul 27 16:36:51.605051 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 69/137] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:51 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:51.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1257328757", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "networks": [{"uuid": "47559312-5240-4014-a676-7ef4172b498a"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:51.929858 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] validate_networks() for [('47559312-5240-4014-a676-7ef4172b498a', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:36:52.322307 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:52.323253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:52.331393 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.332361 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.333680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.334519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.719925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:52.744655 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1b85fb75-de00-4118-92db-8656a98fc0cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.425932 Jul 27 16:36:52.745605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 70/138] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:52 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:52.748850 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:36:52.749522 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:36:52.750254 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:36:52.750835 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:52.750925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:36:52.751327 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:52.751564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:36:52.758344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.758800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.759579 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.760012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.781648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.782153 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.783915 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.795345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:36:52.839794 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Getting quotas for project fef3e0b606114adfbb6ff0c7e5648bea. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:36:52.856452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Getting quotas for user 4fe9ea35543546afab739c0cfa3389fc and project fef3e0b606114adfbb6ff0c7e5648bea. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:36:52.880084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:36:52.883095 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:36:52.919713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ac3b9524-ffef-42c6-bf7f-e13dd7083df9 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 204 len: 0 microversion: 2.1 time: 0.172477 Jul 27 16:36:52.920505 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 71/139] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:36:52 2022] DELETE /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:36:52.927988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:52.929091 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:52.937735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.938602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.939686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.940506 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.941910 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-958e53f8-201d-4e0e-8567-dead37adbc68 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078278 Jul 27 16:36:52.948686 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 69/140] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 16:36:52.954121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:52.955069 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:52.962532 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.963564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:52.964590 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:52.965210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:53.307392 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:53.315727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:53.317011 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-76a58641-33e7-4759-af60-81174f6a075b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.394959 Jul 27 16:36:53.318424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 72/141] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:52 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:53.324256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1aeadca7-7d46-4f65-8547-552ad3125e84 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:53.325257 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1aeadca7-7d46-4f65-8547-552ad3125e84 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:53.338143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9fdfb63c-d783-43d3-843f-41a90d34c97d tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1553 microversion: 2.1 time: 0.388072 Jul 27 16:36:53.338979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 70/142] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:52 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1553 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:53.411416 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1aeadca7-7d46-4f65-8547-552ad3125e84 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:53.418671 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1aeadca7-7d46-4f65-8547-552ad3125e84 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1214 microversion: 2.1 time: 0.098837 Jul 27 16:36:53.419869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 73/143] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:53 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:53.769133 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:53.770060 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:53.777619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:53.778176 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:53.779652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:53.780098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:53.932132 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:53.941886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bf86dbfa-73f6-4dfc-8e6d-013f41a07b76 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.178154 Jul 27 16:36:53.942532 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 71/144] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:53 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:54.341325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:54.341942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:54.347928 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.348571 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.349360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.349800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.363535 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:54.364621 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:54.384098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.384836 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.386342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.386970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.592744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:54.600515 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9a3a8a2f-cb36-4253-b518-84e014cbe302 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.263237 Jul 27 16:36:54.601570 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 74/145] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:54 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:54.605956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:54.606618 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:54.613222 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.613869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.614671 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.615129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.646515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:54.662071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a0e1aa83-60da-4069-81e6-cdc88baa56f0 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1553 microversion: 2.1 time: 0.306070 Jul 27 16:36:54.662580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 72/146] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:54 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:54.701428 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:54.709135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b1d4848e-723c-4847-b96d-931a3b95ca8c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1218 microversion: 2.1 time: 0.106617 Jul 27 16:36:54.709791 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 75/147] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:54 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:54.962035 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:54.963243 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:54.971849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.974219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:54.976326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:54.977349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:55.130060 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:55.138257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-09b0499f-f3d2-4335-8b59-f38527284fa4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.179755 Jul 27 16:36:55.139077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 73/148] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:54 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:55.623305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:55.623987 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:55.630821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:55.631271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:55.632305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:55.632941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:55.683370 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:55.683980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:55.698903 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:55.699347 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:55.700872 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:55.701520 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:55.913684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:55.933398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3f755946-9485-4847-a692-b583715a1e66 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.313061 Jul 27 16:36:55.942150 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 76/149] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:55 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:55.948298 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:55.950152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:55.953367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:55.961034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:55.961792 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:55.962193 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8a98c612-a057-40bc-922e-ba46b377c07f tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1553 microversion: 2.1 time: 0.282493 Jul 27 16:36:55.962771 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 74/150] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:55 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:55.965212 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:55.965657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:56.101595 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:56.115090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-703913dc-7a55-4da9-aa2d-0bdcf2e86058 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1218 microversion: 2.1 time: 0.170586 Jul 27 16:36:56.116034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 77/151] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:55 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:56.161949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:56.162574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:56.170067 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:56.170516 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:56.171454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:56.171884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:56.319033 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:56.327156 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ba3127b5-50d8-47ba-a0e5-dbd70f7e2ca8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1363 microversion: 2.1 time: 0.172167 Jul 27 16:36:56.327730 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 75/152] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:56 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:56.955382 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:56.956052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:56.961896 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:56.962330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:56.963267 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:56.964302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:56.994725 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:56.997480 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:57.007655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.008303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.009271 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.009867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.349612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:57.357826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9c8b40ef-f93e-4c1e-b3ba-bb0a16ffcb74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.406167 Jul 27 16:36:57.358403 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 78/153] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:56 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:57.363030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:57.363628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:57.369600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.370052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.370803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.371230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.400677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:57.410077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8d6a669a-0a1c-41b4-9671-508b629950f2 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1553 microversion: 2.1 time: 0.429740 Jul 27 16:36:57.423669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 76/154] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:56 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1553 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:57.430206 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:57.430981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:57.439037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.439845 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.440794 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.441496 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.482574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:57.494808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fd0322c8-c6fa-4ee2-a584-de06b9d4c4bc tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1266 microversion: 2.1 time: 0.135159 Jul 27 16:36:57.508353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 79/155] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:57 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:57.617623 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:57.626630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-07063b66-f18e-474c-8c5e-10c0308ca313 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1549 microversion: 2.1 time: 0.201655 Jul 27 16:36:57.627190 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 77/156] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:57 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1549 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:57.649856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:57.650697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:57.657054 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.657508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.658282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:57.658716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:57.852342 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e67c72af-c86b-498b-9dc3-38a374df894b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206206 Jul 27 16:36:57.852960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 80/157] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:36:57 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:36:58.381651 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:58.385468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:58.419559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:58.421561 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:58.423420 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:58.424435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:58.432138 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:58.434402 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:58.453534 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:58.454367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:58.457029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:58.457729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:59.260913 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:59.270039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1eb538f4-2a44-4809-95e6-0ca68410f2cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.894437 Jul 27 16:36:59.270656 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 78/158] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:58 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:59.280357 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:36:59.281285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:36:59.289066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:59.289552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:59.290317 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:59.290750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:59.310976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:59.322352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9e3e82b0-58d0-4b18-99ea-c1abfd0459f6 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1553 microversion: 2.1 time: 0.894382 Jul 27 16:36:59.323573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 81/159] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:58 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1553 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:36:59.445437 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:36:59.457446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a30f6847-a6bf-48d0-bc0d-e967fc0b338b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1272 microversion: 2.1 time: 0.185023 Jul 27 16:36:59.470219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 79/160] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:36:59 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:36:59.795474 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-d13e1706-938f-4a3d-ba5d-3b276384b083 req-5c7b354f-53f3-4f63-bc02-f839dc282f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a55b7c3-0254-4b12-a47b-357fa5db50a9", "name": "network-vif-deleted", "tag": "37e635ad-37c3-43df-90e3-5c0a40020c13"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:36:59.812548 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-d13e1706-938f-4a3d-ba5d-3b276384b083 req-5c7b354f-53f3-4f63-bc02-f839dc282f2d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:36:59.813004 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-d13e1706-938f-4a3d-ba5d-3b276384b083 req-5c7b354f-53f3-4f63-bc02-f839dc282f2d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:36:59.871545 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-d13e1706-938f-4a3d-ba5d-3b276384b083 req-5c7b354f-53f3-4f63-bc02-f839dc282f2d service nova] Creating event network-vif-deleted:37e635ad-37c3-43df-90e3-5c0a40020c13 for instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 on hv-cinder-84969 Jul 27 16:36:59.898225 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-d13e1706-938f-4a3d-ba5d-3b276384b083 req-5c7b354f-53f3-4f63-bc02-f839dc282f2d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106371 Jul 27 16:36:59.900644 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 82/161] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:00.292662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:00.293403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:00.317269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.317981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.319066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.319706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.363321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:00.364046 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:00.389154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.389154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.391483 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.391997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.458153 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.458814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.459270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lazy-loading 'fault' on Instance uuid 1a55b7c3-0254-4b12-a47b-357fa5db50a9 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:37:00.554434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5710d1f3a6742e489c7c676cc4c01d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f922d21e1e8434ea5e93938dc56bed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:00.567958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1f3f8bcb-8d49-4bae-b323-ceab49588cdb tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 200 len: 1351 microversion: 2.1 time: 0.224552 Jul 27 16:37:00.569521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 83/162] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:00 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 1351 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:00.577155 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:00.578044 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:00.587191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.587632 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.588912 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:00.589821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:00.601394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:00.604940 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:00.611786 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b991e02b-aa87-4325-9e23-23cb58f27d5a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.323582 Jul 27 16:37:00.612368 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 80/163] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:00 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:00.874172 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:00.884233 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d406312f-d8bb-456c-93f5-8d2077601de7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.312245 Jul 27 16:37:00.884922 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 84/164] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:00 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:01.593439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:01.594060 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:01.603373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.604017 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.604605 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.605075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.620473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] HTTP exception thrown: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Request method failure captured: Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 HTTP/1.1 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlpWArAr7nqHAtWZiJUo17eZdHGUNWYxFv2hL8REnJYuocdqyo5-sGJzgksu1IOP6d-eDsYPunhG5qo0ycbz2x8V2j0Wyh8Bl6whTJjTHL6IjC1F8Pv1-xZYfrCszjaoUj6CDn7KARMVKGFcWbV-AjiONfJltS4pBxlStIYgZUCW80 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:37:01.625941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: c5710d1f3a6742e489c7c676cc4c01d3 Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.627330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '1a55b7c3-0254-4b12-a47b-357fa5db50a9'} Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:01.628125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.629658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.630815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Returning 404 to user: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:01.630815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f00122e5-61a2-4b31-a8a1-9e2b34a156f7 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 404 len: 111 microversion: 2.1 time: 0.038857 Jul 27 16:37:01.630815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 81/165] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:01 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:37:01.635736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:01.636412 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:01.643628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.644106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.645160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.645589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.649991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:01.757176 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:01.759677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:01.767490 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.768147 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.769123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.769716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.783745 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] HTTP exception thrown: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Request method failure captured: Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9/os-volume_attachments HTTP/1.1 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlpWArAr7nqHAtWZiJUo17eZdHGUNWYxFv2hL8REnJYuocdqyo5-sGJzgksu1IOP6d-eDsYPunhG5qo0ycbz2x8V2j0Wyh8Bl6whTJjTHL6IjC1F8Pv1-xZYfrCszjaoUj6CDn7KARMVKGFcWbV-AjiONfJltS4pBxlStIYgZUCW80 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:37:01.790122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: c5710d1f3a6742e489c7c676cc4c01d3 Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.791414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'server_id': '1a55b7c3-0254-4b12-a47b-357fa5db50a9'} Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:01.792227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:01.794179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:01.795232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Returning 404 to user: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:01.795232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d9d53ad9-d29d-4f85-a58b-195cfd9b12cf tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038487 Jul 27 16:37:01.795232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 82/166] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:37:01 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 16:37:01.903398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:01.912273 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dc51c6e3-4448-4fa4-8cf0-12ca79132875 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.283668 Jul 27 16:37:01.912387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:01.912834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 85/167] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:01 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:01.925531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:01.925531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.925531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.925531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.925877 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.952205 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-5e053404-330e-41f3-8b30-e7c9694b925f req-cbe50b43-3ade-493f-b85b-a3df258ad816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0065d67-39b9-4506-a9c5-e3669abc73f3", "tag": "7d079e14-f8f7-43ce-a463-f17c326cc7bb"}, {"name": "network-changed", "server_uuid": "db614fdb-db6b-4550-9da2-f0b0b491da9d", "tag": "e452e79b-bb2e-4940-a160-2e5bf6fa23f8"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:01.968903 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-5e053404-330e-41f3-8b30-e7c9694b925f req-cbe50b43-3ade-493f-b85b-a3df258ad816 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:01.970929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-5e053404-330e-41f3-8b30-e7c9694b925f req-cbe50b43-3ade-493f-b85b-a3df258ad816 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:01.988047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-5e053404-330e-41f3-8b30-e7c9694b925f req-cbe50b43-3ade-493f-b85b-a3df258ad816 service nova] Creating event network-changed:7d079e14-f8f7-43ce-a463-f17c326cc7bb for instance b0065d67-39b9-4506-a9c5-e3669abc73f3 on hv-cinder-84969 Jul 27 16:37:01.988707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-5e053404-330e-41f3-8b30-e7c9694b925f req-cbe50b43-3ade-493f-b85b-a3df258ad816 service nova] Creating event network-changed:e452e79b-bb2e-4940-a160-2e5bf6fa23f8 for instance db614fdb-db6b-4550-9da2-f0b0b491da9d on hv-cinder-84969 Jul 27 16:37:01.998273 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-5e053404-330e-41f3-8b30-e7c9694b925f req-cbe50b43-3ade-493f-b85b-a3df258ad816 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060524 Jul 27 16:37:01.999707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 86/168] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:02.317710 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:02.325723 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1ab692d6-21f0-4d63-a9df-88a0180ab9ca tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.418606 Jul 27 16:37:02.329240 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 83/169] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:01 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:02.936336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:02.937180 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:02.943432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:02.943813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:02.944571 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:02.945040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.087361 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:03.098764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a21d5b23-0403-4c80-b319-632110e9e703 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.166742 Jul 27 16:37:03.099427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 87/170] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:02 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:03.126460 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:03.127014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:03.130213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:03.130856 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:03.135691 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:03.136142 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.136960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:03.137408 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.152717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] HTTP exception thrown: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Request method failure captured: Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 HTTP/1.1 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlpWArAr7nqHAtWZiJUo17eZdHGUNWYxFv2hL8REnJYuocdqyo5-sGJzgksu1IOP6d-eDsYPunhG5qo0ycbz2x8V2j0Wyh8Bl6whTJjTHL6IjC1F8Pv1-xZYfrCszjaoUj6CDn7KARMVKGFcWbV-AjiONfJltS4pBxlStIYgZUCW80 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:37:03.154844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: c5710d1f3a6742e489c7c676cc4c01d3 Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.156257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '1a55b7c3-0254-4b12-a47b-357fa5db50a9'} Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:03.157053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.158167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.159955 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Returning 404 to user: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:03.160796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6ddd776e-ad68-4c10-83c5-7bf341b85363 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 404 len: 111 microversion: 2.1 time: 0.038201 Jul 27 16:37:03.161536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 84/171] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:37:03 2022] DELETE /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:37:03.170009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:03.170618 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] [instance: 1a55b7c3-0254-4b12-a47b-357fa5db50a9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:03.176760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:03.177241 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.178137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:03.178563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.193248 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] HTTP exception thrown: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Request method failure captured: Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 HTTP/1.1 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlpWArAr7nqHAtWZiJUo17eZdHGUNWYxFv2hL8REnJYuocdqyo5-sGJzgksu1IOP6d-eDsYPunhG5qo0ycbz2x8V2j0Wyh8Bl6whTJjTHL6IjC1F8Pv1-xZYfrCszjaoUj6CDn7KARMVKGFcWbV-AjiONfJltS4pBxlStIYgZUCW80 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:37:03.198346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9f922d21e1e8434ea5e93938dc56bed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 9f922d21e1e8434ea5e93938dc56bed9 Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544852327 Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: c5710d1f3a6742e489c7c676cc4c01d3 Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-DeleteServersTestJSON-1544852327-project Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.199766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '1a55b7c3-0254-4b12-a47b-357fa5db50a9'} Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:03.201301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. Jul 27 16:37:03.202317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:03.203286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] Returning 404 to user: Instance 1a55b7c3-0254-4b12-a47b-357fa5db50a9 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:03.203286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-345a5981-bf37-490e-80ee-8554685e3b59 tempest-DeleteServersTestJSON-1544852327 tempest-DeleteServersTestJSON-1544852327-project] 10.222.0.74 "GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9" status: 404 len: 111 microversion: 2.1 time: 0.033801 Jul 27 16:37:03.203286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 88/172] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:03 2022] GET /compute/v2.1/servers/1a55b7c3-0254-4b12-a47b-357fa5db50a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:37:03.346652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:03.347388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:03.353598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:03.354218 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.355608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:03.356204 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:03.889096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:03.900546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0cb3e39c-2e9d-405c-b961-e3ac826acbaf tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.557640 Jul 27 16:37:03.913940 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 85/173] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:03 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:04.119984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:04.120602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:04.126756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:04.130066 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:04.131438 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:04.132466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:04.133161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:04.380221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:04.388930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ae278ea9-995a-4687-96ee-ad2e99b9e377 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.273057 Jul 27 16:37:04.389677 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 89/174] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:04 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:04.928264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:04.930536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:04.939552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:04.940075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:04.941049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:04.941570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:05.141805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:05.151565 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c68866c4-a871-4f6b-9dc5-94ff667b853d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.227508 Jul 27 16:37:05.166789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 86/175] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:04 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:05.412230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:05.413038 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:05.422303 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:05.423589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:05.424361 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:05.424798 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:05.676626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:05.687170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-363a3a6c-5174-454f-b394-4429c79b41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.279380 Jul 27 16:37:05.688060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 90/176] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:05 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:06.174171 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:06.175360 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:06.182527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:06.183284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:06.184614 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:06.185321 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:06.342564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:06.351494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-015f51e6-9e1c-4d04-9c41-0b989e62fb19 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.181560 Jul 27 16:37:06.366052 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 87/177] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:06 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:06.710070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:06.710692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:06.724369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:06.725268 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:06.731022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:06.731522 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:07.082209 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:07.095076 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b31b8857-1e3b-4144-945b-0da4d34c7fd1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.388662 Jul 27 16:37:07.109828 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 91/178] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:06 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:07.378914 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:07.383068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:07.398742 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:07.399189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:07.399959 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:07.400446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:07.590013 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:07.601642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-36102186-c566-404f-9bcc-12379921c99e tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.233668 Jul 27 16:37:07.602470 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 88/179] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:07 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:08.086732 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-bb00c1e2-31cb-435d-b553-b6390f629d70 req-b524f4ea-8c69-407a-b93b-009b6ef8ae2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db614fdb-db6b-4550-9da2-f0b0b491da9d", "name": "network-vif-plugged", "status": "completed", "tag": "e452e79b-bb2e-4940-a160-2e5bf6fa23f8"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:08.098469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-bb00c1e2-31cb-435d-b553-b6390f629d70 req-b524f4ea-8c69-407a-b93b-009b6ef8ae2f service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:08.098957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-bb00c1e2-31cb-435d-b553-b6390f629d70 req-b524f4ea-8c69-407a-b93b-009b6ef8ae2f service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:08.113209 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-bb00c1e2-31cb-435d-b553-b6390f629d70 req-b524f4ea-8c69-407a-b93b-009b6ef8ae2f service nova] Creating event network-vif-plugged:e452e79b-bb2e-4940-a160-2e5bf6fa23f8 for instance db614fdb-db6b-4550-9da2-f0b0b491da9d on hv-cinder-84969 Jul 27 16:37:08.119351 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-bb00c1e2-31cb-435d-b553-b6390f629d70 req-b524f4ea-8c69-407a-b93b-009b6ef8ae2f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036529 Jul 27 16:37:08.121002 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 92/180] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:08.122533 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:08.124105 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:08.130796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:08.131244 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:08.132388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:08.133139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:08.331719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:08.353946 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dff89296-802f-4433-996c-a89b99348b4f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.237349 Jul 27 16:37:08.355078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 89/181] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:08 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:08.624956 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:08.625569 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:08.631975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:08.632421 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:08.633211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:08.633647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:08.731962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4fabb59a-bff1-4e66-b386-25efd9700ce8 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Action: 'create', calling method: .version_select at 0x7ff56ce78670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-98293047", "metadata": {"Type": "work"}}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:08.776852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:08.784799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-511e6b1b-7b37-4f12-b3da-1c2e3192ddce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.165124 Jul 27 16:37:08.785397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 90/182] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:08 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:09.046196 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4fabb59a-bff1-4e66-b386-25efd9700ce8 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.440671 Jul 27 16:37:09.046926 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 93/183] 10.222.0.74 () {60 vars in 1156 bytes} [Wed Jul 27 16:37:08 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 16:37:09.060706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e80442f3-d448-429e-92b6-c6c92ff667dc tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Calling method '.version_select at 0x7ff56c8ac700>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:09.108880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e80442f3-d448-429e-92b6-c6c92ff667dc tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c" status: 200 len: 351 microversion: 2.1 time: 0.053037 Jul 27 16:37:09.109486 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 91/184] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:37:09 2022] GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:09.376978 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:09.377700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:09.383965 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:09.384406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:09.385196 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:09.385624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:09.529927 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:09.537549 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1ee12fca-2a51-4722-929c-578bd7c2678e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.164328 Jul 27 16:37:09.538156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 94/185] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:09 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:09.805669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:09.806317 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:09.813058 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:09.813513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:09.814280 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:09.814717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:09.941719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:09.949127 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-95bc2b34-d559-451c-9c88-f7d66afdc104 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1314 microversion: 2.1 time: 0.147921 Jul 27 16:37:09.949680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 92/186] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:09 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:10.122830 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1c4355e3-36ce-43eb-b675-a09cf60f2a22 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Calling method '.version_select at 0x7ff56ce18430>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:10.173879 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1c4355e3-36ce-43eb-b675-a09cf60f2a22 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c" status: 200 len: 352 microversion: 2.1 time: 0.055222 Jul 27 16:37:10.181826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 95/187] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:37:10 2022] GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:10.187332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9d728e9a-e793-47bf-8fab-a31c299414b9 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Calling method '.version_select at 0x7ff56c58fa60>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:10.235188 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9d728e9a-e793-47bf-8fab-a31c299414b9 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c" status: 200 len: 352 microversion: 2.1 time: 0.051960 Jul 27 16:37:10.235748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 93/188] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:37:10 2022] GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:10.253162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c2610c42-a614-4a36-8dbf-1c860a2cd230 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Calling method '.version_select at 0x7ff56ce78d30>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:10.317810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c2610c42-a614-4a36-8dbf-1c860a2cd230 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c" status: 202 len: 0 microversion: 2.1 time: 0.068481 Jul 27 16:37:10.318371 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 96/189] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:37:10 2022] DELETE /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:37:10.326397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d4dd3d2f-d4da-4532-933d-47811af29820 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Calling method '.version_select at 0x7ff56c6ac430>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:10.375863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d4dd3d2f-d4da-4532-933d-47811af29820 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c" status: 200 len: 351 microversion: 2.1 time: 0.053232 Jul 27 16:37:10.376442 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 94/190] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:37:10 2022] GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:10.559863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:10.561856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:10.569356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:10.569771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:10.570640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:10.571546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:10.727116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:10.735117 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1a711ebc-1e6f-4ab6-9051-9d820702b706 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.180144 Jul 27 16:37:10.735880 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 97/191] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:10 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:10.970287 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:10.971092 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:10.976415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:10.983755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:10.984286 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:10.985343 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:10.985785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:11.136862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:11.145076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9e0cabdf-67ac-4e19-95e7-756a5f9c6404 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1497 microversion: 2.1 time: 0.178598 Jul 27 16:37:11.145873 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 95/192] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:10 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:11.398409 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0a790f0c-7e9c-4244-abf2-92c2f980ad49 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Calling method '.version_select at 0x7ff56ce789d0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:11.433295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-0a790f0c-7e9c-4244-abf2-92c2f980ad49 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] HTTP exception thrown: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0a790f0c-7e9c-4244-abf2-92c2f980ad49 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Request method failure captured: Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c HTTP/1.1 Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wm0fNDIZsIS5hdxgIAERanPtpDxw2g15qMxc56CVWccuCaA0UNiiUvhxJislMCtXxndsjDhSYfoycec9KhQWCEFo_qgyPRDNR0ccUvrzUAgKeVrts1pxyVByQits4_DdCYC11TqytGq4YnDvSv9-vY89kpgPCAFPtNTgUstQCXWV3U Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 6dcf43cc1ef44b87bfe61bfb7cbd8f3a Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesGetTestJSON-1053146706 Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:37:11.437756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6dcf43cc1ef44b87bfe61bfb7cbd8f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6dcf43cc1ef44b87bfe61bfb7cbd8f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_6dcf43cc1ef44b87bfe61bfb7cbd8f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/6dcf43cc1ef44b87bfe61bfb7cbd8f3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesGetTestJSON-1053146706 Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 6dcf43cc1ef44b87bfe61bfb7cbd8f3a Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesGetTestJSON-1053146706 Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesGetTestJSON-1053146706-project Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 7207784d76a2457189bbf2df82a17172 Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesGetTestJSON-1053146706-project Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'f10921c7-ec56-4180-bf33-413722db250c'} Jul 27 16:37:11.438929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. (HTTP 404) (Request-ID: req-96c7c759-69ed-4e49-aba4-9b9cfc81e837) Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:11.439648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:37:11.440675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 16:37:11.441694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0a790f0c-7e9c-4244-abf2-92c2f980ad49 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] Returning 404 to user: Volume f10921c7-ec56-4180-bf33-413722db250c could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0a790f0c-7e9c-4244-abf2-92c2f980ad49 tempest-VolumesGetTestJSON-1053146706 tempest-VolumesGetTestJSON-1053146706-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c" status: 404 len: 109 microversion: 2.1 time: 0.053656 Jul 27 16:37:11.444072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 98/193] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:37:11 2022] GET /compute/v2.1/os-volumes/f10921c7-ec56-4180-bf33-413722db250c => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 16:37:11.688041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:11.688866 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:11.698015 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:11.699546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:11.701502 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:11.702257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:11.752590 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:37:11.758995 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:11.759664 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:11.771375 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:11.772176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:11.773194 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:11.773848 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:11.859716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-95df11e7-7214-4b9c-a18b-fb024eefba47 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "DELETE /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 204 len: 0 microversion: 2.1 time: 0.177231 Jul 27 16:37:11.860729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 96/194] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:37:11 2022] DELETE /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:37:11.870012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:11.870796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:11.877155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:11.877598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:11.879668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:11.880972 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:12.084198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:12.097448 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b33ce025-dd2a-4d15-a383-70ba54ff6b62 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.344895 Jul 27 16:37:12.097790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 99/195] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:11 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:12.145466 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:12.162011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0686941b-ada1-4099-8154-5489387969ce tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1503 microversion: 2.1 time: 0.296154 Jul 27 16:37:12.169721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 97/196] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:11 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:13.119085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:13.119808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:13.127028 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:13.127623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:13.128636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:13.129198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:13.194977 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:13.195803 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:13.207897 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:13.210099 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:13.211407 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:13.214658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:13.399303 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:13.411579 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a4a5adff-bdd7-4ab2-a356-83d114d5b5a6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.296118 Jul 27 16:37:13.413246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 100/197] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:13 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:13.436501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:13.444350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2b99d8b8-e086-4062-8370-0f87e6409da3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1503 microversion: 2.1 time: 0.256631 Jul 27 16:37:13.445202 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 98/198] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:13 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:14.384342 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-6f785929-3fdf-4cee-9704-2125219f445c req-1b76a7a1-8ad4-4ddc-adcf-b8a12dd12151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db614fdb-db6b-4550-9da2-f0b0b491da9d", "name": "network-vif-deleted", "tag": "e452e79b-bb2e-4940-a160-2e5bf6fa23f8"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:14.434393 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:14.434960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:14.436207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-6f785929-3fdf-4cee-9704-2125219f445c req-1b76a7a1-8ad4-4ddc-adcf-b8a12dd12151 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:14.442501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-6f785929-3fdf-4cee-9704-2125219f445c req-1b76a7a1-8ad4-4ddc-adcf-b8a12dd12151 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:14.450900 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:14.451787 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:14.453741 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:14.454568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:14.483604 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-6f785929-3fdf-4cee-9704-2125219f445c req-1b76a7a1-8ad4-4ddc-adcf-b8a12dd12151 service nova] Creating event network-vif-deleted:e452e79b-bb2e-4940-a160-2e5bf6fa23f8 for instance db614fdb-db6b-4550-9da2-f0b0b491da9d on hv-cinder-84969 Jul 27 16:37:14.496172 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-6f785929-3fdf-4cee-9704-2125219f445c req-1b76a7a1-8ad4-4ddc-adcf-b8a12dd12151 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130286 Jul 27 16:37:14.500589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 101/199] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:14.518900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:14.519851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:14.529643 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:14.530383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:14.531672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:14.532536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:14.586739 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:14.587452 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:14.588076 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lazy-loading 'fault' on Instance uuid db614fdb-db6b-4550-9da2-f0b0b491da9d {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:37:14.650565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:14.654562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:14.663721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dda9b28c-cda1-4aea-832d-3c15d9179832 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.233863 Jul 27 16:37:14.664806 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 99/200] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:14 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:14.665145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b8a7b937-c9c1-4328-8344-d2ed56a42725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 200 len: 1304 microversion: 2.1 time: 0.162347 Jul 27 16:37:14.665706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 102/201] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:14 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:15.689643 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:15.690487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:15.690871 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: db614fdb-db6b-4550-9da2-f0b0b491da9d] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:15.691750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:15.699310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:15.700792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:15.701738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:15.702317 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:15.705369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:15.705910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:15.708522 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:15.710693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:15.747517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] HTTP exception thrown: Instance db614fdb-db6b-4550-9da2-f0b0b491da9d could not be found. Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Request method failure captured: Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d HTTP/1.1 Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wmix0xZVO5VyOfhBbWa5qV0AeEflJpoRbUAFfoT8fkiMD88VfAxCzFLlXx2gjN4nQMjO7RmmbeFfslbhY4chretEQchhuR9s6NC2AwtYtWo_nTLTctMk_5KO6G98buGcTCwBXmxNf81DZTVl08vY7Cg9hK7680_aiQSSC7EBif03oM Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: fef3e0b606114adfbb6ff0c7e5648bea Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesActionsTest-1589379644 Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:37:15.756426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesActionsTest-1589379644 Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: fef3e0b606114adfbb6ff0c7e5648bea Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesActionsTest-1589379644 Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesActionsTest-1589379644-project Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 4fe9ea35543546afab739c0cfa3389fc Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesActionsTest-1589379644-project Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance db614fdb-db6b-4550-9da2-f0b0b491da9d could not be found. Jul 27 16:37:15.757795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'db614fdb-db6b-4550-9da2-f0b0b491da9d'} Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db614fdb-db6b-4550-9da2-f0b0b491da9d could not be found. Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:15.758508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db614fdb-db6b-4550-9da2-f0b0b491da9d could not be found. Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db614fdb-db6b-4550-9da2-f0b0b491da9d could not be found. Jul 27 16:37:15.759610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:15.762940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Returning 404 to user: Instance db614fdb-db6b-4550-9da2-f0b0b491da9d could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:15.764146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d02b0a4e-7ef5-4b85-b51f-e624f7d1ed6c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d" status: 404 len: 111 microversion: 2.1 time: 0.080245 Jul 27 16:37:15.764940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 103/202] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:15 2022] GET /compute/v2.1/servers/db614fdb-db6b-4550-9da2-f0b0b491da9d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 16:37:15.905504 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:15.910768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:15.925245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c294f178-349b-4162-b435-6e715510b07e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.239573 Jul 27 16:37:15.927122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 100/203] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:15 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:15.963328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-760588499", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "networks": [{"uuid": "47559312-5240-4014-a676-7ef4172b498a"}]}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:16.041519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] validate_networks() for [('47559312-5240-4014-a676-7ef4172b498a', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:37:16.543748 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:37:16.544260 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:37:16.544799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:37:16.545296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:37:16.545770 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:37:16.554890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:16.555452 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:16.556493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:16.557028 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:16.574405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Getting quotas for project fef3e0b606114adfbb6ff0c7e5648bea. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:37:16.578974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Getting quotas for user 4fe9ea35543546afab739c0cfa3389fc and project fef3e0b606114adfbb6ff0c7e5648bea. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:37:16.590203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:37:16.593177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:37:16.640201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4178dc52-ff2a-4220-855a-42638968f3a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681841 Jul 27 16:37:16.646764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 104/204] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:37:16.660808 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f0f0e359-7817-44c4-9657-1cec4e2edeb2 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:16.661472 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f0f0e359-7817-44c4-9657-1cec4e2edeb2 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:16.727361 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f0f0e359-7817-44c4-9657-1cec4e2edeb2 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:16.734496 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f0f0e359-7817-44c4-9657-1cec4e2edeb2 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1213 microversion: 2.1 time: 0.086665 Jul 27 16:37:16.735137 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 101/205] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:16 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:16.951528 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:16.952344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:16.959918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:16.960607 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:16.961719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:16.962451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:17.118851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:17.118851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b00b373e-7f13-45a8-9461-d89307cb83a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.169796 Jul 27 16:37:17.118851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 105/206] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:16 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:17.755307 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:17.756080 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:17.764688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:17.765214 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:17.765996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:17.766454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:17.866867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:17.879830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b77b3569-ef68-4a76-bec4-08e9a4885fe8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1273 microversion: 2.1 time: 0.126630 Jul 27 16:37:17.888973 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 102/207] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:17 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:18.139025 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:18.139638 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:18.145552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:18.145999 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:18.146794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:18.147226 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:18.279927 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:18.287205 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-435a19e4-da15-4b04-a5c2-146843159ccf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.152698 Jul 27 16:37:18.287767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 106/208] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:18 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:18.903437 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:18.903946 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:18.910398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:18.910841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:18.911619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:18.912047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:18.972589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:18.982148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-921bd396-fb30-433f-8ec2-781cebb46f9b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1271 microversion: 2.1 time: 0.081900 Jul 27 16:37:18.982821 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 103/209] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:18 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:19.307592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:19.308203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:19.314288 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:19.314737 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:19.315485 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:19.315913 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:19.440696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:19.448063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6850ee90-c81d-416a-bb92-f063cbe25bd8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.144326 Jul 27 16:37:19.448612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 107/210] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:19 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:20.003817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:20.004523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:20.010970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:20.011415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:20.012165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:20.013277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:20.076231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:20.083521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ef741f94-de1f-4444-bae5-cfa822057c76 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1271 microversion: 2.1 time: 0.083548 Jul 27 16:37:20.084081 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 104/211] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:19 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:20.468938 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:20.469558 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:20.471649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:20.477418 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:20.477855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:20.478629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:20.479060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:20.882396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:20.890459 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7fb66d88-501a-4e16-a1c9-2b550d221671 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.425410 Jul 27 16:37:20.891026 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 108/212] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:20 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:21.103632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:21.104386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:21.110914 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:21.111355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:21.112143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:21.112573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:21.192677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:21.200760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-653080c5-3ccb-4747-b9b3-3364f3875456 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1271 microversion: 2.1 time: 0.100558 Jul 27 16:37:21.201351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 105/213] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:21 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:21.911681 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:21.912317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:21.918272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:21.919286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:21.920030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:21.920451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:21.938556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:22.055665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:22.063098 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9c3fd547-116e-4db8-ac74-b8402f4c46ac tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.155194 Jul 27 16:37:22.063656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 109/214] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:21 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:22.223504 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:22.224112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:22.230679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:22.231739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:22.232553 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:22.233017 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:22.362267 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:22.369713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-59da85f1-0942-44af-b848-59212e10400d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.150096 Jul 27 16:37:22.370271 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 106/215] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:22 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:23.084514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:23.085191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:23.091368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:23.091812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:23.092573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:23.093043 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:23.123353 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-ef593def-cece-49f3-9e00-e3fa8c6b82fa req-4273803b-eba2-4dd5-9165-4d3e506db1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08429cca-b299-45bc-838e-0c4318fd40b6", "tag": "12837a6b-0a40-4b1d-87f4-e08d27d43b9d"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:23.132708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ef593def-cece-49f3-9e00-e3fa8c6b82fa req-4273803b-eba2-4dd5-9165-4d3e506db1ca service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:23.133201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ef593def-cece-49f3-9e00-e3fa8c6b82fa req-4273803b-eba2-4dd5-9165-4d3e506db1ca service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:23.144718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-ef593def-cece-49f3-9e00-e3fa8c6b82fa req-4273803b-eba2-4dd5-9165-4d3e506db1ca service nova] Creating event network-changed:12837a6b-0a40-4b1d-87f4-e08d27d43b9d for instance 08429cca-b299-45bc-838e-0c4318fd40b6 on hv-cinder-84969 Jul 27 16:37:23.149868 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-ef593def-cece-49f3-9e00-e3fa8c6b82fa req-4273803b-eba2-4dd5-9165-4d3e506db1ca service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030625 Jul 27 16:37:23.150765 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 107/216] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:37:23.245704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:23.253746 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-26549e8f-420b-4f97-bf17-4aba2ab7de22 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.173164 Jul 27 16:37:23.254331 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 110/217] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:23 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:23.390888 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:23.391500 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:23.397652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:23.398094 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:23.398841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:23.399270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:23.617189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:23.624523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d929c8fb-71f4-48f2-a352-6365a192d9c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.238378 Jul 27 16:37:23.625121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 108/218] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:23 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:24.274444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:24.275058 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:24.282029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:24.282472 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:24.283219 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:24.283643 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:24.415791 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:24.425918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-36e44dd3-1217-464c-8bff-e69a953272fc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.155120 Jul 27 16:37:24.426484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 111/219] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:24 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:24.645470 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:24.646097 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:24.652529 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:24.653002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:24.653751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:24.654178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:24.805453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:24.813426 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-474bd276-cfe1-40ff-9cd2-1228b2f6feb9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.172189 Jul 27 16:37:24.813985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 109/220] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:24 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:25.447572 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:25.448120 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:25.454749 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:25.455195 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:25.455949 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:25.456383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:25.583680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:25.591269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cd8a30cb-55e8-43f3-9035-e8669b186156 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.147639 Jul 27 16:37:25.592384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 112/221] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:25 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:25.833876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:25.834491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:25.842165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:25.842691 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:25.843618 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:25.844084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:25.971763 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:25.979298 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ee55a09b-3c6c-4aec-ad73-f56dbbca56c3 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.149224 Jul 27 16:37:25.979865 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 110/222] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:25 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:26.612257 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:26.612981 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:26.614890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:26.615714 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=6 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:26.621218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:26.621775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:26.623181 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:26.623684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:26.753378 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:26.760820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dd5b9534-fae2-4e49-9c11-cc861df1a9ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.152387 Jul 27 16:37:26.761405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 113/223] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:26 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:27.001046 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:27.001656 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:27.003666 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:27.009366 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:27.009812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:27.010639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:27.011073 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:27.182305 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:27.195302 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9f1b874e-c4e9-4450-b5fd-9f19b2dab76c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.198133 Jul 27 16:37:27.195887 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 111/224] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:26 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:27.783294 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:27.783815 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:27.789794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:27.790245 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:27.791003 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:27.791435 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:27.921841 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:27.929433 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-431da7f6-c6cd-40b1-b266-7aaa5589bd08 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.150873 Jul 27 16:37:27.929988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 114/225] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:27 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:28.218030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:28.218842 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:28.225456 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:28.225905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:28.226676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:28.227113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:28.356024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:28.364106 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-15b297e2-8a82-4cca-94d9-f40313610683 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.150151 Jul 27 16:37:28.364662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 112/226] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:28 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:28.950025 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:28.951308 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:28.958169 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:28.958812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:28.959725 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:28.960310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:29.097898 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:29.105265 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-876fcfd5-4a18-4bad-a7a4-94b947d65e7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.159059 Jul 27 16:37:29.105886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 115/227] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:28 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:29.384578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:29.385209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:29.391643 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:29.392085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:29.392841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:29.393292 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:29.522798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:29.530707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d90d6c46-c911-4c3e-89ea-188508055020 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.149937 Jul 27 16:37:29.531252 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 113/228] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:29 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:30.126577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:30.127133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:30.133095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:30.133536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:30.134279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:30.134704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:30.263255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:30.270537 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-565c1c19-017d-46c7-9a85-5fe146291359 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.148449 Jul 27 16:37:30.271091 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 116/229] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:30 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:30.551712 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:30.552324 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:30.558611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:30.559055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:30.559814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:30.560269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:30.703109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:30.710443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-52129645-841b-4cd7-8ee7-55c9776e6cf1 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.162631 Jul 27 16:37:30.711000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 114/230] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:30 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:31.291540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:31.292077 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:31.298300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:31.298750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:31.299504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:31.299933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:31.433654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:31.442780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b4db5214-573b-4d14-88aa-c28441e870c0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.154734 Jul 27 16:37:31.443347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 117/231] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:31 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:31.737396 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:31.737396 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:31.744160 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:31.744829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:31.745737 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:31.746390 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:32.016329 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-4ceafb75-4e19-444a-bf11-877d3b3cf618 req-80d83576-03aa-42fd-87bf-5d8a3a5c5c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08429cca-b299-45bc-838e-0c4318fd40b6", "name": "network-vif-plugged", "status": "completed", "tag": "12837a6b-0a40-4b1d-87f4-e08d27d43b9d"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:32.030193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-4ceafb75-4e19-444a-bf11-877d3b3cf618 req-80d83576-03aa-42fd-87bf-5d8a3a5c5c02 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:32.030646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-4ceafb75-4e19-444a-bf11-877d3b3cf618 req-80d83576-03aa-42fd-87bf-5d8a3a5c5c02 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:32.046124 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-4ceafb75-4e19-444a-bf11-877d3b3cf618 req-80d83576-03aa-42fd-87bf-5d8a3a5c5c02 service nova] Creating event network-vif-plugged:12837a6b-0a40-4b1d-87f4-e08d27d43b9d for instance 08429cca-b299-45bc-838e-0c4318fd40b6 on hv-cinder-84969 Jul 27 16:37:32.051826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-4ceafb75-4e19-444a-bf11-877d3b3cf618 req-80d83576-03aa-42fd-87bf-5d8a3a5c5c02 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040427 Jul 27 16:37:32.052960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 118/232] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:37:32.064174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:32.072707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-de7513cf-418c-403f-97b1-37110b22c0bd tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.344222 Jul 27 16:37:32.073652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 115/233] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:31 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:32.464411 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:32.465177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:32.471285 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:32.471736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:32.472496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:32.472957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:32.638987 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:32.646812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1ab9c302-72fb-46bb-9685-b8b4954eb5f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.186905 Jul 27 16:37:32.647385 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 119/234] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:32 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:33.097169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:33.097802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:33.104698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:33.105170 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:33.105927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:33.106356 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:33.241149 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:33.249484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-31b6bd1f-2c00-4f8d-86b5-8e0866a4a1a8 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.155950 Jul 27 16:37:33.250053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 116/235] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:33 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:33.670122 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:33.670793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:33.676806 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:33.677278 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:33.678033 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:33.678462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:33.811810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:33.819308 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-aced8163-bee6-4c98-9f34-245976266091 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.153373 Jul 27 16:37:33.819870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 120/236] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:33 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:34.270265 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:34.271440 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:34.277855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:34.278297 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:34.279557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:34.279985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:34.409331 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:34.416706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e5e57747-2a73-4d11-bc24-6f4bab7ca754 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.150302 Jul 27 16:37:34.417299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 117/237] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:34 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:34.840907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:34.841511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:34.847667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:34.848108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:34.848866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:34.849319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:34.975228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:34.983558 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ab4ea0f6-6ad3-47e6-a2b2-424728721718 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.146788 Jul 27 16:37:34.984363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 121/238] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:34 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:35.438065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:35.438719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:35.445553 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:35.445998 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:35.446767 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:35.447198 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:35.579518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:35.587062 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-06a2770d-009e-41dd-bab5-69049bd88131 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.153879 Jul 27 16:37:35.587681 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 118/239] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:35 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:36.003960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:36.004574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:36.012004 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:36.012524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:36.014146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:36.014771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:36.155647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:36.163621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cb167f4a-8607-4c3b-955f-628d532b9bad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.163870 Jul 27 16:37:36.164121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 122/240] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:35 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:36.608293 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:36.609012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:36.615581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:36.616030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:36.616796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:36.617264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:36.621228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:36.752023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:36.759726 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3c36dbff-1b31-4319-9546-fc0208cc914c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.155342 Jul 27 16:37:36.760287 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 119/241] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:36 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:37.183323 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:37.183933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:37.190138 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:37.190579 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:37.191330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:37.191760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:37.328286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:37.335881 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5790c394-dd1a-4ee1-8d2e-e2c39cfb2b25 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.156351 Jul 27 16:37:37.336432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 123/242] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:37 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:37.785380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:37.785997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:37.792537 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:37.793026 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:37.794412 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:37.794860 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:37.928182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:37.936398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4557e028-21fd-4fa0-8514-76459d36300d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.156343 Jul 27 16:37:37.936966 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 120/243] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:37 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:38.357632 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:38.358292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:38.364520 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:38.364936 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:38.365682 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:38.366177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:38.497936 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:38.505359 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1b13458b-2269-49a0-aa46-c90cdb2b6222 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1521 microversion: 2.1 time: 0.152058 Jul 27 16:37:38.505907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 124/244] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:38 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:38.957009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:38.957631 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:38.964372 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:38.964827 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:38.965618 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:38.966056 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:39.094697 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:39.102336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-713c0203-5f27-48fa-8b9f-519bde58e0b4 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.149205 Jul 27 16:37:39.102895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 121/245] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:38 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:39.526386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:39.526958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:39.534198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:39.534547 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:39.548137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:39.548616 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:39.680276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:39.687796 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6ed40d25-c373-4429-ba90-06d955a3be43 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1501 microversion: 2.1 time: 0.165369 Jul 27 16:37:39.688365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 125/246] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:39 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:39.707767 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:39.708383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:39.714686 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:39.715136 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:39.716021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:39.717035 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:39.848253 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:39.857826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5ccf16a5-ca69-4836-9c72-26eb75c644cf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1514 microversion: 2.1 time: 0.152980 Jul 27 16:37:39.858607 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 122/247] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:39 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:40.124135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:40.124794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:40.131129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:40.131576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:40.132520 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:40.133205 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:40.270576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:40.274313 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:40.279607 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8b4382ea-1c9e-40ad-aee4-049ee21ec725 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.160133 Jul 27 16:37:40.280183 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 126/248] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:40 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:41.300477 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:41.301115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:41.303124 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:41.308322 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:41.308762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:41.309547 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:41.309973 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:41.439110 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:41.446368 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c65a0d14-7518-4255-8176-725bd327f791 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.149728 Jul 27 16:37:41.446918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 123/249] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:41 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:42.467988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:42.468618 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:42.474793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:42.475237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:42.476004 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:42.476434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:42.614063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:42.622215 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-46d493f3-3da6-4ccc-bd1d-c8a31f0a6489 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1313 microversion: 2.1 time: 0.158916 Jul 27 16:37:42.622777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 127/250] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:42 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:43.643174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:43.643792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:43.650462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:43.650917 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:43.651686 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:43.652125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:43.812768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:43.820376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b58d9eba-56b6-44bf-9f6f-0686b381f970 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1497 microversion: 2.1 time: 0.181139 Jul 27 16:37:43.820799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 124/251] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:43 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:44.393506 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:44.395754 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:44.402057 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.402508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.404239 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.404697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.429379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'flavor' on Instance uuid 71c4add4-825e-428a-b0ba-a2f6447d80a7 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:37:44.498552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:44.499416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:44.507689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.508457 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.509399 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.509845 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.535349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:37:44.550996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-96b95a85-a248-4449-ad93-0ba84945153a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/action" status: 200 len: 32 microversion: 2.1 time: 0.161484 Jul 27 16:37:44.551774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 128/252] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:37:44 2022] POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:37:44.562178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:44.562886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:44.568971 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.569425 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.570189 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.570615 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.633300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bf2503c9-81c7-4271-8ad3-2fa9bf4e5566 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "DELETE /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 204 len: 0 microversion: 2.1 time: 0.141294 Jul 27 16:37:44.634151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 125/253] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:37:44 2022] DELETE /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:37:44.642949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:44.643652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:44.649791 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.650249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.651012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:44.651441 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:44.812052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:44.819886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-77b349d1-6c19-447d-8941-8a1e7ba46511 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.262692 Jul 27 16:37:44.820641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 129/254] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:44 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:44.839859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:44.847619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-78c3cdff-ecb8-4ac3-8fa6-2cabcd0934c7 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1503 microversion: 2.1 time: 0.209470 Jul 27 16:37:44.848182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 126/255] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:44 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:45.846711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:45.847290 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:45.853336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:45.853779 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:45.854560 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:45.854984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:45.868651 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:45.869300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:45.876158 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:45.876608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:45.877582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:45.878025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:46.074099 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:46.079692 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:46.086155 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d142b53d-fea5-415f-9221-fa5b969759d5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.243268 Jul 27 16:37:46.086834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 130/256] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:45 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:46.090640 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d0210345-098e-4241-9248-345c9677fd3b tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1503 microversion: 2.1 time: 0.225777 Jul 27 16:37:46.091257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 127/257] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:45 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:47.110310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:47.110947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:47.117357 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:47.117820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:47.118584 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:47.119017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:47.121325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:47.121969 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:47.129651 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:47.130103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:47.130898 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:47.131320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:47.324455 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:47.331068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:47.333212 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a3d4443d-78d0-4e7b-bf25-ae8bdf244bdc tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.226729 Jul 27 16:37:47.333864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 131/258] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:47 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:47.338557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2a2e2a74-4b99-49dd-a17e-bebf96c306f9 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1503 microversion: 2.1 time: 0.221421 Jul 27 16:37:47.339107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 128/259] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:47 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:48.358394 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:48.359012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:48.362002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:48.362809 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:48.365097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:48.365547 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:48.366712 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:48.366847 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:48.370121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:48.370596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:48.371474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:48.371792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:48.639946 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:48.643074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:48.647887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e8d0f724-a27d-4789-b91d-0b155183c7a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.295454 Jul 27 16:37:48.648551 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 132/260] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:48 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:48.650523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-962f7aea-ea2e-4069-af71-3feea34ab698 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1503 microversion: 2.1 time: 0.294534 Jul 27 16:37:48.651213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 129/261] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:48 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:49.671603 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:49.672318 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:49.672685 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:49.672784 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:49.679403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:49.679588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:49.679943 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:49.680318 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:49.680710 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:49.681170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:49.681340 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:49.681965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:50.076957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:50.079892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:50.085863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-28e06b48-6af4-4c03-88f0-f4245f81a13c tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1503 microversion: 2.1 time: 0.417792 Jul 27 16:37:50.099584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 130/262] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:49 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:50.103924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-78db76fd-2986-4d9d-a940-1d611ee43453 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.435275 Jul 27 16:37:50.104858 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 133/263] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:49 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:50.360540 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-3251afe3-882f-4a41-bc33-900209e67341 req-cff278ab-1d88-487d-97ea-3a9af5b97af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08429cca-b299-45bc-838e-0c4318fd40b6", "name": "network-vif-deleted", "tag": "12837a6b-0a40-4b1d-87f4-e08d27d43b9d"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:37:50.374231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-3251afe3-882f-4a41-bc33-900209e67341 req-cff278ab-1d88-487d-97ea-3a9af5b97af9 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:50.374956 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-3251afe3-882f-4a41-bc33-900209e67341 req-cff278ab-1d88-487d-97ea-3a9af5b97af9 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:50.388863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-3251afe3-882f-4a41-bc33-900209e67341 req-cff278ab-1d88-487d-97ea-3a9af5b97af9 service nova] Creating event network-vif-deleted:12837a6b-0a40-4b1d-87f4-e08d27d43b9d for instance 08429cca-b299-45bc-838e-0c4318fd40b6 on hv-cinder-84969 Jul 27 16:37:50.395605 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-3251afe3-882f-4a41-bc33-900209e67341 req-cff278ab-1d88-487d-97ea-3a9af5b97af9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038564 Jul 27 16:37:50.398006 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 131/264] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:37:51.108112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:51.108955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:51.111253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=52 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:51.117094 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:51.117576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:51.118330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:51.118754 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:51.129632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:51.130573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:51.138754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:51.139242 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:51.140177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:51.140807 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:51.151413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:51.152085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:51.152683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lazy-loading 'fault' on Instance uuid 08429cca-b299-45bc-838e-0c4318fd40b6 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:37:51.198617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:51.206285 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1e6b0bd5-daa6-406b-ab88-096e284402af tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1303 microversion: 2.1 time: 0.102867 Jul 27 16:37:51.207003 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 134/265] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:51 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:51.295378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:51.303960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d56ecbd9-5861-4d2b-947b-01b0af5a6148 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.179679 Jul 27 16:37:51.304619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 132/266] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:51 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:52.228388 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:52.229029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:52.235354 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:52.235800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:52.236551 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:52.237246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:52.267397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:52.267837 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:52.268553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lazy-loading 'fault' on Instance uuid 08429cca-b299-45bc-838e-0c4318fd40b6 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:37:52.313648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:52.321345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-69cb6748-dde3-4d70-943b-6437e415d48d tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1303 microversion: 2.1 time: 0.097022 Jul 27 16:37:52.321904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 135/267] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:52 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:52.323702 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:52.324326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:52.331564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:52.332030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:52.332799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:52.333268 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:52.463774 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:52.474377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a27e66f2-7f3d-44fa-9b69-1d2d066b0d8a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.154439 Jul 27 16:37:52.474942 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 133/268] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:52 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:37:53.342982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:53.343594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:53.349570 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:53.350011 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:53.350766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:53.351206 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:53.382256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:53.382691 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:53.383128 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lazy-loading 'fault' on Instance uuid 08429cca-b299-45bc-838e-0c4318fd40b6 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:37:53.424059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe9ea35543546afab739c0cfa3389fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef3e0b606114adfbb6ff0c7e5648bea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:53.442708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c95f3ae6-5334-4485-b9b4-04c8c2ac1fe0 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 200 len: 1303 microversion: 2.1 time: 0.103784 Jul 27 16:37:53.455835 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 136/269] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:53 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:53.497815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:53.498434 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:53.508678 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:53.509421 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:53.510377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:53.510804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:53.645979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:53.649502 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:53.654632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ac50e7fb-e278-4c98-99a1-e22457f9916e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.162375 Jul 27 16:37:53.655194 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 134/270] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:53 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:54.463535 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:54.464151 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] [instance: 08429cca-b299-45bc-838e-0c4318fd40b6] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:54.471051 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:54.471496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:54.472251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:54.472755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:54.490397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] HTTP exception thrown: Instance 08429cca-b299-45bc-838e-0c4318fd40b6 could not be found. Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Request method failure captured: Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 HTTP/1.1 Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wmix0xZVO5VyOfhBbWa5qV0AeEflJpoRbUAFfoT8fkiMD88VfAxCzFLlXx2gjN4nQMjO7RmmbeFfslbhY4chretEQchhuR9s6NC2AwtYtWo_nTLTctMk_5KO6G98buGcTCwBXmxNf81DZTVl08vY7Cg9hK7680_aiQSSC7EBif03oM Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: fef3e0b606114adfbb6ff0c7e5648bea Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesActionsTest-1589379644 Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:37:54.493623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/fef3e0b606114adfbb6ff0c7e5648bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesActionsTest-1589379644 Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: fef3e0b606114adfbb6ff0c7e5648bea Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesActionsTest-1589379644 Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesActionsTest-1589379644-project Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 4fe9ea35543546afab739c0cfa3389fc Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesActionsTest-1589379644-project Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 08429cca-b299-45bc-838e-0c4318fd40b6 could not be found. Jul 27 16:37:54.494956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '08429cca-b299-45bc-838e-0c4318fd40b6'} Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08429cca-b299-45bc-838e-0c4318fd40b6 could not be found. Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:37:54.495633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08429cca-b299-45bc-838e-0c4318fd40b6 could not be found. Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08429cca-b299-45bc-838e-0c4318fd40b6 could not be found. Jul 27 16:37:54.496823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:37:54.498065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] Returning 404 to user: Instance 08429cca-b299-45bc-838e-0c4318fd40b6 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:37:54.498065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bdb43d2a-4a9a-48e9-aae5-a32e40d4d726 tempest-VolumesActionsTest-1589379644 tempest-VolumesActionsTest-1589379644-project] 10.222.0.74 "GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6" status: 404 len: 111 microversion: 2.1 time: 0.036109 Jul 27 16:37:54.498065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 137/271] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:54 2022] GET /compute/v2.1/servers/08429cca-b299-45bc-838e-0c4318fd40b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:37:54.675117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:54.676003 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:54.683782 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:54.684157 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:54.685029 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:54.685469 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:54.838663 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:54.847602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b33aa923-280c-4167-a1bf-2430670327f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.176194 Jul 27 16:37:54.848184 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 135/272] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:54 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:55.867129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:55.867742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:55.874730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:55.877366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:55.878248 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:55.880431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:56.035816 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:56.043493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-da2d1358-7ebe-4e6f-8be8-4ca842f7323e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.180024 Jul 27 16:37:56.044663 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 138/273] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:55 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:57.066332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:57.066947 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:57.073798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:57.074246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:57.075541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:57.076023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:57.208708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:57.217150 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1c521a13-f939-4538-aa97-0b00939c8ce0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.154703 Jul 27 16:37:57.217718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 136/274] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:57 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:58.237588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:58.238191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:58.244152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:58.244593 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:58.245365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:58.245792 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:58.373043 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:58.382511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-09ba629a-f186-49ec-8150-3519d70c450a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.148643 Jul 27 16:37:58.383072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 139/275] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:58 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:37:59.404116 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:37:59.404116 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:37:59.410595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:59.411053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:59.411825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:37:59.412263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:37:59.553430 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:37:59.566288 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f143c497-e796-4fa9-80e5-02783ac92188 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.166560 Jul 27 16:37:59.567221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 137/276] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:37:59 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:00.588325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:00.588968 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:00.595866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:00.596311 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:00.597281 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:00.597997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:00.763709 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:00.773162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-17761ff0-661d-4bc1-820a-7debd0c15c20 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.188102 Jul 27 16:38:00.786688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 140/277] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:00 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:01.800815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:01.801583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:01.812544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:01.813014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:01.813782 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:01.814222 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:01.971611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:01.990716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-37f1588e-17af-412d-a091-a3a46fa0e2a5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.195762 Jul 27 16:38:01.991832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 138/278] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:01 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:03.014962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:03.016401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:03.024301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:03.025207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:03.026502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:03.026948 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:03.032421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:03.295934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:03.307786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-21fbe0d7-3025-4854-a683-3a3a14be45f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.297467 Jul 27 16:38:03.325728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 141/279] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:03 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:04.333116 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:04.334834 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:04.342543 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:04.343615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:04.344812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:04.345498 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:04.506760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:04.517473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-311e1f48-b38f-4099-bf40-9217a797903d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.188002 Jul 27 16:38:04.518612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 139/280] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:04 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:05.540124 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:05.540814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:05.549689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:05.550577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:05.551645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:05.552252 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:05.704049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:05.712519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2529abc2-b027-4cf8-adb2-eac4f3f15025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.176503 Jul 27 16:38:05.713617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 142/281] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:05 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:06.735112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:06.736456 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:06.744399 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:06.744964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:06.745973 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:06.746615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:06.924471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:06.933268 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f4fb2060-293d-41d2-b674-5c0c41a048d1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.202426 Jul 27 16:38:06.934376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 140/282] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:06 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:07.957833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:07.959833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:07.968543 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:07.969129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:07.970254 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:07.970684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:08.136577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:08.144774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2d3f76b6-26cb-402e-93aa-30b4a6c06f38 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.192235 Jul 27 16:38:08.145463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 143/283] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:07 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:08.629884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:08.630428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:08.636833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:08.637350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:08.638611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:08.639041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:08.662994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-df1dcdb4-3ed1-42ad-b71f-c46bf6a30b5d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/ips" status: 200 len: 150 microversion: 2.1 time: 0.036886 Jul 27 16:38:08.663534 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 141/284] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:38:08 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:09.167156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:09.167769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:09.174397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:09.174844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:09.175597 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:09.176031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:09.318080 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:09.326934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b4e3c64b-62a1-499a-ab59-42c8728e3beb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.163557 Jul 27 16:38:09.327620 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 144/285] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:09 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:10.349903 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:10.350510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:10.357464 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:10.357912 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:10.358673 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:10.359274 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:10.517512 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:10.525685 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-846eef3b-d1cf-4913-9334-073f53b84b2d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.179569 Jul 27 16:38:10.526392 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 142/286] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:10 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:11.098497 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17ceef98-d4fa-4678-962c-d7fce744e437"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:11.101042 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:11.107764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:11.108207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:11.108994 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:11.109424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:11.549122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:11.549727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:11.551987 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:11.560316 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:11.564455 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e7e78dee-1d13-4048-a77b-8cddf4426d86 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469351 Jul 27 16:38:11.569370 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 145/287] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:38:11 2022] POST /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:11.573919 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:11.575958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:11.576983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:11.801227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:11.814663 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1fd83b86-a4ce-4398-b5ee-33bb781420b7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.269241 Jul 27 16:38:11.817413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 143/288] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:11 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:12.839967 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:12.841255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:12.847763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:12.848201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:12.848988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:12.849424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:13.002717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:13.010198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-10e3d69b-380b-4eb2-8f36-a8b4f148024c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.175156 Jul 27 16:38:13.010754 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 146/289] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:12 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:14.031150 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:14.031904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:14.038540 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:14.039203 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:14.040174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:14.040794 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:14.183040 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:14.193161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3bc1e5ff-549f-4544-b9a6-1f8e2d300a40 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.166040 Jul 27 16:38:14.194182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 144/290] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:14 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:15.216843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:15.217473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:15.224304 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:15.224751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:15.225581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:15.226012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:15.359187 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:15.366822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-eaf5167a-c762-46e7-a7fd-bbba6b01e552 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.155126 Jul 27 16:38:15.367378 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 147/291] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:15 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:16.388108 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:16.389104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:16.396021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:16.396738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:16.398085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:16.398524 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:16.554550 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:16.567164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0a23f07b-c298-442c-8953-6299336377f0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.183074 Jul 27 16:38:16.573474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 145/292] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:16 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:17.429638 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:17.430218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:17.437126 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:17.437567 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:17.438316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:17.438740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:17.462532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5823a652-5a33-4adf-b6e3-c556df4043b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/ips" status: 200 len: 152 microversion: 2.20 time: 0.036730 Jul 27 16:38:17.463245 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 148/293] 10.222.0.74 () {60 vars in 1289 bytes} [Wed Jul 27 16:38:17 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:38:17.591416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:17.592842 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:17.600962 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:17.601638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:17.602441 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:17.603147 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:17.827516 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:17.838363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff55a9a0-11a7-4a06-831b-89d08f994068 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.252978 Jul 27 16:38:17.852605 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 146/294] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:17 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:18.864212 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:18.865144 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:18.871833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:18.872310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:18.873166 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:18.873619 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:19.060019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:19.070132 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0e670f24-89f7-4eb7-a6dd-1cc184fb0719 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.209800 Jul 27 16:38:19.070874 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 149/295] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:18 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:19.200531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2e9847fb-afa8-406f-ad22-af2ee46cd318 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: .version_select at 0x7ff56c578dc0>, body: {"keypair": {"name": "tempest-keypair-1862658022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsw9IVoHrd4hi/CDY/pv5rw0bS2PemiAeN1pOHr32f0ohwfHvY5LbqjP5clfhPds/s0ZlJvoy7qVMRzt27BEUGmIkH6xcc6Hvq2Sd1CGCAmdkSQzEKml62SOJOiwwckTQ=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:19.218869 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-2e9847fb-afa8-406f-ad22-af2ee46cd318 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:38:19.223331 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-2e9847fb-afa8-406f-ad22-af2ee46cd318 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:38:19.245845 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2e9847fb-afa8-406f-ad22-af2ee46cd318 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049958 Jul 27 16:38:19.247161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 147/296] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:38:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:20.092335 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:20.093063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:20.103356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:20.104122 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:20.105324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:20.106805 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:20.316226 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:20.329353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-47f4b382-3dd4-4e03-b9ce-9c99445ec3a3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.241249 Jul 27 16:38:20.345702 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 150/297] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:20 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:20.741561 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2113195526", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22edebd8-fe29-44cb-9c58-64fe5ac1da5e"}], "security_groups": [{"name": "tempest-securitygroup--285909495"}], "key_name": "tempest-keypair-1862658022", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:21.355669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:21.356953 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:21.359331 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=40 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:21.364860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:21.365342 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:21.366109 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:21.366542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:21.503059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:21.510915 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e684f900-34e3-48c8-9541-3a9b0b0d3fd6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.159628 Jul 27 16:38:21.511500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 151/298] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:21 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:22.532290 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:22.533005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:22.539338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:22.539788 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:22.540551 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:22.541021 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:22.681602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:22.690581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-174ec9cc-96c9-4356-9f8c-dad45aee7ffb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.162912 Jul 27 16:38:22.691143 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 152/299] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:22 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:23.206167 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:23.206702 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:23.212830 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:23.213304 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:23.214060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:23.214498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:23.239588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lazy-loading 'flavor' on Instance uuid a008e56d-969e-442a-bb08-524ee7e06084 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:38:25.553895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] validate_networks() for [('22edebd8-fe29-44cb-9c58-64fe5ac1da5e', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:38:25.587928 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3994242b-02cc-4e4b-9aee-9ed708f7c867 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/action" status: 202 len: 0 microversion: 2.20 time: 2.385458 Jul 27 16:38:25.588610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 153/300] 10.222.0.74 () {62 vars in 1319 bytes} [Wed Jul 27 16:38:23 2022] POST /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/action => generated 0 bytes in 2387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:38:25.594221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:25.595000 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:25.603138 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:25.604302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:25.605188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:25.606345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:25.806068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:25.809764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:25.814626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b188faf4-c07e-4167-b53b-871d74abcb23 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.224797 Jul 27 16:38:25.815201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 154/301] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:25 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:25.819784 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:25.820386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:25.827640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:25.828119 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:25.828912 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:25.829355 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:26.039821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:26.049384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:26.051175 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:26.052552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3007cb7d-b85b-41e0-936b-613e230bb961 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.236404 Jul 27 16:38:26.053293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 155/302] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:25 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:26.072812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:38:26.073433 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:38:26.073931 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:38:26.074337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:38:26.074777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:38:26.083566 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:26.084010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:26.084805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:26.085268 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:26.092739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=71 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:26.103981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:38:26.108488 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:38:26.119729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:38:26.122061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:38:26.169107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fd9f43e5-7b65-45ea-aa23-1f86adf961b0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.434323 Jul 27 16:38:26.169642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 148/303] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:38:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 5436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:38:26.180681 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-df1ff40d-2245-4176-93a1-51614e725570 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:26.181338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-df1ff40d-2245-4176-93a1-51614e725570 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:26.236109 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-df1ff40d-2245-4176-93a1-51614e725570 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:26.243235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-df1ff40d-2245-4176-93a1-51614e725570 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1242 microversion: 2.1 time: 0.066508 Jul 27 16:38:26.243787 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 156/304] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:26 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:26.836045 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:26.836690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:26.847128 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:26.847581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:26.848349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:26.848812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:26.995568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:27.005536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d9eb7349-1f96-4d36-9be4-68da9c03813b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.173631 Jul 27 16:38:27.006308 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 149/305] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:26 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:27.076358 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:27.077331 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:27.085513 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:27.086019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:27.086875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:27.087350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:27.241880 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:27.261082 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:27.264738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:27.265477 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:27.266202 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:27.268519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-76517cf3-1fe0-4282-82df-41e7d846c509 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.196748 Jul 27 16:38:27.273599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:27.274313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:27.275357 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:27.275991 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:27.277461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 157/306] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:27 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:27.344215 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:27.351893 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ec3cb2fd-186f-4b7c-9bb6-5ba5056f60e5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1294 microversion: 2.1 time: 0.091880 Jul 27 16:38:27.352449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 150/307] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:27 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:28.027252 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:28.028379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:28.034481 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:28.034932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:28.035692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:28.036122 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:28.165375 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:28.173729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-27b9216b-be54-481d-9bc2-cbb096be23e6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.150225 Jul 27 16:38:28.174300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 158/308] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:28 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:28.296241 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:28.296855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:28.303473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:28.303918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:28.304677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:28.305138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:28.373299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:28.374152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:28.380719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:28.381722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:28.382608 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:28.383136 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:28.497188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:28.507866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3930d032-a7fe-47f5-9dbb-47d859c8f231 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1302 microversion: 2.1 time: 0.137943 Jul 27 16:38:28.508757 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 159/309] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:28 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:28.562115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:28.571177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:28.573030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:28.574266 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-92257bb4-ec8d-4b9e-ab79-5dfc0a29b1ae tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.282619 Jul 27 16:38:28.575373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 151/310] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:28 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:29.193911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:29.197777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:29.209287 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.209800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.210739 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.211531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.387092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:29.395680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fb20ff8c-ece3-46e0-a19a-b3b389c6b47f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1500 microversion: 2.1 time: 0.205531 Jul 27 16:38:29.398328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 160/311] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:29 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1500 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:29.417554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b38ee755-03b8-4962-b549-f79778ac6693"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:29.422428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:29.431572 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.432210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.433221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.434519 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.466897 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] HTTP exception thrown: Cannot 'attach_volume' instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 while it is in vm_state rescued Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Request method failure captured: Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/os-volume_attachments HTTP/1.1 Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 74 Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl4H6d4xrnvKRf52a3XvC7iojjzkdC5E4bq_pdSyAj-9OEEIVcu1WF2FA8RUGLlxfHE2cab0VdhGBD5aTSy_jwJ1QsAqlcK-XqWuU9SGqPXB-htrjLch8A6pE2c8LTfzHGi8fpiSZc4MBt4K164Sj57iqErVr68mXYWCPKErbz9y7w Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:38:29.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 1c0838069cba4d1389ec6fc809db70a7 Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {"volumeAttachment": {"volumeId": "b38ee755-03b8-4962-b549-f79778ac6693"}} Jul 27 16:38:29.469896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Cannot 'attach_volume' instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 while it is in vm_state rescued Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'server_id': '71c4add4-825e-428a-b0ba-a2f6447d80a7', 'body': {'volumeAttachment': {'volumeId': 'b38ee755-03b8-4962-b549-f79778ac6693'}}} Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:38:29.470622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 while it is in vm_state rescued Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:38:29.471864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:38:29.473922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:38:29.473922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:38:29.473922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 while it is in vm_state rescued Jul 27 16:38:29.473922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:38:29.473922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Returning 409 to user: Cannot 'attach_volume' instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 while it is in vm_state rescued {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:38:29.476702 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-eb406b61-418d-431c-9130-7ea47ef002f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059655 Jul 27 16:38:29.478466 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 152/312] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:38:29 2022] POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 16:38:29.486704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:29.487275 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:29.500331 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.500803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.503945 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.504380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.532350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:29.534024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:29.547976 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.552568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.553668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.555743 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.645477 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-97a23936-4dce-4f37-bdf5-f1f463d008ae tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/action" status: 202 len: 0 microversion: 2.1 time: 0.162512 Jul 27 16:38:29.646403 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 161/313] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:38:29 2022] POST /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:38:29.653566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:29.654759 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:29.661790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.663320 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.664513 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:29.665693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:29.981277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:29.990172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c59c788e-ea1b-47d1-b642-a3c397981caa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.461469 Jul 27 16:38:29.992655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 153/314] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:29 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:29.996955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:30.000514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:30.001398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:30.008033 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:30.009580 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:30.011381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:30.011795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2c785f79-6608-4d78-bcc6-7db1124d2c5c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.362875 Jul 27 16:38:30.012369 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:30.023775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 162/315] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:29 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:30.025167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:30.025796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:30.240225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:30.255107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7284e173-27d9-4dcf-9e01-8dca95437f59 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1508 microversion: 2.1 time: 0.260044 Jul 27 16:38:30.255708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 154/316] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:29 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:30.547500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-1565cdd9-246b-4b37-91fe-5bdf3580bfbb req-75eed89c-8385-4600-be75-156fa6a6852b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b72f0b5-a0b5-458b-9cbb-7216d34be718", "tag": "48f4dc5d-66f7-4d76-acfc-3857b17ffa1e"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:30.563161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-1565cdd9-246b-4b37-91fe-5bdf3580bfbb req-75eed89c-8385-4600-be75-156fa6a6852b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:30.563599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-1565cdd9-246b-4b37-91fe-5bdf3580bfbb req-75eed89c-8385-4600-be75-156fa6a6852b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:30.584702 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-1565cdd9-246b-4b37-91fe-5bdf3580bfbb req-75eed89c-8385-4600-be75-156fa6a6852b service nova] Creating event network-changed:48f4dc5d-66f7-4d76-acfc-3857b17ffa1e for instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 on hv-cinder-84969 Jul 27 16:38:30.589905 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-1565cdd9-246b-4b37-91fe-5bdf3580bfbb req-75eed89c-8385-4600-be75-156fa6a6852b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046969 Jul 27 16:38:30.591798 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 163/317] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:31.014223 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:31.014959 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:31.021711 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.022162 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.023096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.023539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.040074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:31.041044 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:31.048308 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.048758 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.049556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.050273 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.247453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:31.252460 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:31.261150 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:31.264089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:31.264248 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e012c279-d159-4acc-944d-523122fa3ee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.254472 Jul 27 16:38:31.264766 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 155/318] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:31 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:31.265284 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-61ee4c8f-f0fa-45d2-865b-5b8e36c8059a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.229738 Jul 27 16:38:31.266220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 164/319] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:31 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:31.270072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:31.270833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:31.276699 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:31.277337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:31.278671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.279355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.280780 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.281448 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.284537 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.285034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.285800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:31.286562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:31.310799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a9e24c2d-2780-4f5f-8d32-04ebd1e712c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/ips" status: 200 len: 146 microversion: 2.1 time: 0.044497 Jul 27 16:38:31.311540 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 156/320] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:38:31 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:31.421602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:31.428986 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c0cc6829-f848-40e6-aada-1977a39a11d2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1508 microversion: 2.1 time: 0.157484 Jul 27 16:38:31.429537 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 165/321] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:31 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:32.308745 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:32.309426 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:32.309792 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:32.309890 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:32.316501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:32.316946 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:32.317469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:32.317615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:32.318243 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:32.318446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:32.318866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:32.319073 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:32.552447 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:32.555763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:32.562066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:32.563631 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:32.563924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0909edeb-c6f7-427f-98b2-813abb22fbdf tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.258977 Jul 27 16:38:32.564664 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 166/322] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:32 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:32.564970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e28c4e6c-0f27-41f6-b715-2b8a0558d52b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.260043 Jul 27 16:38:32.565558 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 157/323] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:32 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:32.569769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:32.570563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:32.579242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:32.579698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:32.580463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:32.580955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:32.822470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:32.833814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-22073e0a-dea0-4015-b892-d92eb2315ec6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1508 microversion: 2.1 time: 0.267533 Jul 27 16:38:32.834722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 167/324] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:32 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:33.585518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:33.586781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:33.589261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:33.590765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:33.595306 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:33.595754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:33.596986 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:33.597695 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:33.597838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:33.598737 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:33.599715 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:33.600144 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:33.841949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:33.846494 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:33.850127 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0730b3f1-aee7-4416-b197-33eeef66f844 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.268612 Jul 27 16:38:33.850776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 158/325] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:33 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:33.856546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:33.856686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:33.857443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:33.858121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:33.859339 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-004df322-a5fe-4c7d-96f2-edb09fc46ed7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.275648 Jul 27 16:38:33.869671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:33.870422 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:33.872404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:33.872934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:33.873538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 168/326] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:33 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:34.024367 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:34.032991 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-183d92cf-b125-43e3-9c9e-959c1aac82f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1508 microversion: 2.1 time: 0.181143 Jul 27 16:38:34.033564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 159/327] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:33 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:34.872914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:34.873537 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:34.882166 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:34.882836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:34.883794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:34.884387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:34.885886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:34.887808 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:34.897557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:34.898795 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:34.900418 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:34.900755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.102944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:35.111377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:35.121517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-11d6cc67-df56-4ccb-96ff-6b9da028cd12 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.252930 Jul 27 16:38:35.121927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:35.122087 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 169/328] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:34 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:35.123892 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:35.125481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9c841781-eb14-49d3-91f1-2f08f903e9b5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.245054 Jul 27 16:38:35.126602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-356568938", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "networks": [{"uuid": "bf03c05d-0ec2-48e8-8d9f-dc0e8a2213ab"}]}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:35.137739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 160/329] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:34 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:35.146602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:35.150968 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:35.163820 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:35.164319 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.165194 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:35.167459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.246806 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] validate_networks() for [('bf03c05d-0ec2-48e8-8d9f-dc0e8a2213ab', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:38:35.436045 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:35.445880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cce604e1-bdb6-4f16-ac28-3027331ddd41 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1514 microversion: 2.1 time: 0.306802 Jul 27 16:38:35.448187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 161/330] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:35 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:35.462173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3ddd635-9518-48a7-b908-a0f20eac0ad4"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:35.465753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:35.482153 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:35.483148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.484108 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:35.484710 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.770817 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:38:35.771239 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:38:35.771708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:38:35.772111 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:38:35.772518 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:38:35.783581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:35.784253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.785128 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:35.785758 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:35.808222 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Getting quotas for project ce1f193c68ef49b78c95c02f7413b7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:38:35.812845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Getting quotas for user 00f17de515184c01a73c454c7f0b7e70 and project ce1f193c68ef49b78c95c02f7413b7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:38:35.825314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:38:35.827676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:38:35.884834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-36518779-4d36-49e6-bf81-232805e946ec tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761701 Jul 27 16:38:35.885914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 170/331] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:38:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:38:35.905563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8ef24b2f-c3b3-47a7-ba79-31a9509e1392 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:35.906190 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8ef24b2f-c3b3-47a7-ba79-31a9509e1392 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:35.950600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7b37dc05-a533-4e25-8973-f7b01362f6c8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492346 Jul 27 16:38:35.957237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 162/332] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:38:35 2022] POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:36.009056 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8ef24b2f-c3b3-47a7-ba79-31a9509e1392 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:36.028588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8ef24b2f-c3b3-47a7-ba79-31a9509e1392 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1218 microversion: 2.1 time: 0.130201 Jul 27 16:38:36.030495 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 171/333] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:35 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:36.143011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:36.143974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:36.149795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:36.150765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:36.151296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:36.152502 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=10 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:36.158313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:36.158592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:36.158985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:36.159597 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:36.159783 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:36.160325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:36.160731 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:36.160855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:36.372146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:36.376720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:36.381087 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:36.382870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:36.384107 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f4b54ad4-c9ae-4e31-a8eb-ee44edc0f796 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.238527 Jul 27 16:38:36.384738 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 172/334] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:36 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:36.392997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6e602b5d-dce8-49b7-96e6-4b550206d725 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.246434 Jul 27 16:38:36.392997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 163/335] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:36 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:36.832059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-454b97f3-6b59-4063-98a1-aa24d27e6577 req-02202808-7ae7-4039-821a-52c73146a888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b72f0b5-a0b5-458b-9cbb-7216d34be718", "name": "network-vif-plugged", "status": "completed", "tag": "48f4dc5d-66f7-4d76-acfc-3857b17ffa1e"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:36.842645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-454b97f3-6b59-4063-98a1-aa24d27e6577 req-02202808-7ae7-4039-821a-52c73146a888 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:36.843129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-454b97f3-6b59-4063-98a1-aa24d27e6577 req-02202808-7ae7-4039-821a-52c73146a888 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:36.856400 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-454b97f3-6b59-4063-98a1-aa24d27e6577 req-02202808-7ae7-4039-821a-52c73146a888 service nova] Creating event network-vif-plugged:48f4dc5d-66f7-4d76-acfc-3857b17ffa1e for instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 on hv-cinder-84969 Jul 27 16:38:36.861298 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-454b97f3-6b59-4063-98a1-aa24d27e6577 req-02202808-7ae7-4039-821a-52c73146a888 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032884 Jul 27 16:38:36.862360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 173/336] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:37.016996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7122aba6-0f10-4788-9e9f-8d2d4948053d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'create', calling method: .version_select at 0x7ff56c5131f0>, body: {"keypair": {"name": "tempest-keypair-963661506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRDT7JKoXV+nPHirlqenAEvGI2mz6lTcfzPvxdXeM/59u5uNJ+79cltyD/6OQ/jrRIdrDb4YWYujW8Z6fVXf6lx/u2ko0eV8QgN06mYbgDAKItWIoP4BVy8CZS+3nFYYQ=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:37.042016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-7122aba6-0f10-4788-9e9f-8d2d4948053d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for project 027a003da80c43ca9b4b337527b93d3a. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:38:37.047040 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-7122aba6-0f10-4788-9e9f-8d2d4948053d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for user 1c0838069cba4d1389ec6fc809db70a7 and project 027a003da80c43ca9b4b337527b93d3a. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:38:37.051314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:37.052252 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:37.063252 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:37.063609 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:37.064619 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:37.065092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:37.074437 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7122aba6-0f10-4788-9e9f-8d2d4948053d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062321 Jul 27 16:38:37.075699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 164/337] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:38:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:37.101141 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:37.190760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:37.202933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dad237ca-d670-4805-8581-74419ffb4e7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1278 microversion: 2.1 time: 0.156693 Jul 27 16:38:37.204450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 174/338] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:37 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:37.407209 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:37.412374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:37.413008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:37.416299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:37.419959 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:37.420404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:37.421208 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:37.421643 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:37.423207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:37.423746 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:37.424590 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:37.425161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:37.624113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:37.627546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:37.634457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:37.636121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-69dcf79b-2d61-471f-bde2-ea84d52a737d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.227579 Jul 27 16:38:37.636791 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 165/339] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:37 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:37.648414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:37.650109 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:37.651269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6afcff04-9d06-4c29-a7a0-790c50024f6a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.248152 Jul 27 16:38:37.651885 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 175/340] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:37 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:38.226158 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:38.226769 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:38.234217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:38.234744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:38.235650 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:38.236152 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:38.412043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:38.420481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-38d686bc-f7fa-42c0-918a-69d179e3b912 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.198347 Jul 27 16:38:38.432913 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 166/341] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:38 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:38.658239 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:38.658846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:38.665291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:38.665733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:38.666484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:38.666909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:38.675668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:38.676378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:38.682897 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:38.683341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:38.685012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:38.685448 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:39.210243 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:39.219864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-44e08f2d-4a0b-46cb-9b52-b8c40ba4d533 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.564670 Jul 27 16:38:39.222383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:39.224145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 176/342] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:38 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:39.231744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:39.234440 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:39.236283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a8c97460-d986-430a-ba6f-1c04d7ba3e01 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.564264 Jul 27 16:38:39.237355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 167/343] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:38 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:39.358070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1772236905", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d36a590e-5aca-4f4b-84ba-ed6272112a6f"}], "security_groups": [{"name": "tempest-securitygroup--1859481745"}], "key_name": "tempest-keypair-963661506", "user_data": "}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:39.442493 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:39.443183 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:39.449621 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:39.450073 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:39.450843 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:39.451279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:39.470375 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] validate_networks() for [('d36a590e-5aca-4f4b-84ba-ed6272112a6f', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:38:39.664273 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:39.673094 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7cf655c7-07ac-4626-911a-5733cab34385 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.234674 Jul 27 16:38:39.673750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 168/344] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:39 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:39.909901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:38:39.910366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:38:39.910782 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:38:39.911424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:38:39.911852 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:38:39.921027 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:39.921476 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:39.922271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:39.922709 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:39.939223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for project 027a003da80c43ca9b4b337527b93d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:38:39.943145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Getting quotas for user 1c0838069cba4d1389ec6fc809db70a7 and project 027a003da80c43ca9b4b337527b93d3a. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:38:39.954479 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:38:39.956712 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:38:40.008391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-86e0e53f-9157-4d15-a22d-af238576a8b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.655602 Jul 27 16:38:40.009125 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 177/345] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:38:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:38:40.020982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ca1f7e9f-8a61-46ba-9564-b2af6e2e5083 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:40.021595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ca1f7e9f-8a61-46ba-9564-b2af6e2e5083 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:40.076644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ca1f7e9f-8a61-46ba-9564-b2af6e2e5083 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:40.084620 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ca1f7e9f-8a61-46ba-9564-b2af6e2e5083 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1245 microversion: 2.1 time: 0.067592 Jul 27 16:38:40.085223 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 169/346] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:40 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:40.241893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:40.242879 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:40.251602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.252163 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.254592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.254592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.262945 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:40.267918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:40.284001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.291488 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.292378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.293020 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.464030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:40.476150 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-313975d5-01b5-4274-ad0e-ac906374b53d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.238878 Jul 27 16:38:40.477203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 178/347] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:40 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:40.511473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:40.520044 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:40.521768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:40.522937 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-deb573e5-2190-4bf1-abd9-fe12acc336c1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.267059 Jul 27 16:38:40.523499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 170/348] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:40 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:40.694503 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:40.695034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:40.702626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.703073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.704369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.704369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.839497 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:40.847195 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-25abadad-698d-43ca-ba86-23df1db0b3b9 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.156635 Jul 27 16:38:40.847755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 179/349] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:40 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:40.948664 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-10191aaf-1190-404b-ad76-4915605364e9 req-c4fc8143-f47c-43b8-953c-33f7dc46aed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c4ea75-9961-4644-8a94-8461f019fa5a", "tag": "c45f72a2-0106-4ad5-ab26-60fca9b2968b"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:40.967627 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-10191aaf-1190-404b-ad76-4915605364e9 req-c4fc8143-f47c-43b8-953c-33f7dc46aed7 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:40.968075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-10191aaf-1190-404b-ad76-4915605364e9 req-c4fc8143-f47c-43b8-953c-33f7dc46aed7 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:40.979607 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-10191aaf-1190-404b-ad76-4915605364e9 req-c4fc8143-f47c-43b8-953c-33f7dc46aed7 service nova] Creating event network-changed:c45f72a2-0106-4ad5-ab26-60fca9b2968b for instance 17c4ea75-9961-4644-8a94-8461f019fa5a on hv-cinder-84969 Jul 27 16:38:40.984452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-10191aaf-1190-404b-ad76-4915605364e9 req-c4fc8143-f47c-43b8-953c-33f7dc46aed7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041182 Jul 27 16:38:40.985061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 171/350] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:41.106824 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:41.107504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:41.114474 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.114919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.115677 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.116108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.202178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:41.209823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2398f7ca-6f09-4845-a025-b05298de10ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1297 microversion: 2.1 time: 0.107739 Jul 27 16:38:41.210421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 180/351] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:41 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:41.500995 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:41.501637 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:41.507909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.508354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.509146 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.509632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.547939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:41.548699 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:41.555274 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.555803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.556690 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.557352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.735461 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:41.743098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-65b4edd3-3cc0-4e27-ba36-4395c4fb9b13 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1367 microversion: 2.1 time: 0.247528 Jul 27 16:38:41.743754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 172/352] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:41 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:41.747589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:41.755597 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:41.757156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:41.758306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-60b65fe1-b63b-441a-b187-c076e1fd8a26 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.215089 Jul 27 16:38:41.759477 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 181/353] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:41 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:41.867355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:41.868041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:41.870002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:41.875268 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:41.876482 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:41.876941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.004649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:42.012552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-46441a4b-0ef1-4b38-ba19-ddd2306c1c31 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.148451 Jul 27 16:38:42.013066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 173/354] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:41 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:42.233282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:42.233982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:42.240496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:42.241056 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.241942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:42.242430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.308203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:42.317187 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b29b1a52-6e72-452e-b143-9c7ae834569e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.088960 Jul 27 16:38:42.317858 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 182/355] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:42 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:42.764687 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:42.765401 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:42.772482 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:42.773015 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.773880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:42.774418 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.781744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:42.782351 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:42.788732 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:42.789217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.790110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:42.790544 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:42.974604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:42.981814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:42.982856 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f52ffc78-e39e-4c8e-811e-eeca8641fbf5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1557 microversion: 2.1 time: 0.222613 Jul 27 16:38:42.983431 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 174/356] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:42 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:42.989843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:42.991337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:42.992866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f26d93f5-da13-4f9c-a597-b1ace4148c75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.214884 Jul 27 16:38:42.993928 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 183/357] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:42 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:43.003455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:43.004566 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:43.010618 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:43.011061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:43.011881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:43.012311 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:43.033469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:43.034053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:43.036876 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:43.040924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:43.041375 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:43.042140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:43.042573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:43.120536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-64972465-a19f-433c-9285-43dfac28ddce tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120888 Jul 27 16:38:43.121219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 175/358] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:38:42 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:43.187012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:43.194465 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2a1490b0-d847-420f-b36b-e95cadadc739 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.164926 Jul 27 16:38:43.195032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 184/359] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:43 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:43.338995 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:43.339627 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:43.346500 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:43.346943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:43.347708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:43.348154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:43.410076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:43.417534 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cdf25f94-ecbb-421b-b127-b58c769caf69 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.082487 Jul 27 16:38:43.418096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 176/360] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:43 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:44.019976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:44.020652 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:44.029013 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.029013 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.029685 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.030134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.071376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-e1e9623f-60f3-4358-89e9-c42833e8e1b9 req-69910d8b-4c72-4480-ba81-7a941c5c0368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b72f0b5-a0b5-458b-9cbb-7216d34be718", "tag": "48f4dc5d-66f7-4d76-acfc-3857b17ffa1e"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:44.083103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e1e9623f-60f3-4358-89e9-c42833e8e1b9 req-69910d8b-4c72-4480-ba81-7a941c5c0368 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.083840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e1e9623f-60f3-4358-89e9-c42833e8e1b9 req-69910d8b-4c72-4480-ba81-7a941c5c0368 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.096190 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e1e9623f-60f3-4358-89e9-c42833e8e1b9 req-69910d8b-4c72-4480-ba81-7a941c5c0368 service nova] Creating event network-changed:48f4dc5d-66f7-4d76-acfc-3857b17ffa1e for instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 on hv-cinder-84969 Jul 27 16:38:44.101294 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-e1e9623f-60f3-4358-89e9-c42833e8e1b9 req-69910d8b-4c72-4480-ba81-7a941c5c0368 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034301 Jul 27 16:38:44.102507 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 177/361] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:38:44.194142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:44.202168 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:44.203665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:44.204819 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-745742af-6385-4864-9b01-e7dd22cd61d1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.188953 Jul 27 16:38:44.205401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 185/362] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:44 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:44.215863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:44.216801 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:44.223139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.223602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.224353 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.224787 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.357602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:44.366706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-abcba3f0-2ae2-4394-861f-93e9a1fcc114 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.155228 Jul 27 16:38:44.367310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 178/363] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:44 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:44.438905 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:44.439690 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:44.446161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.446692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.447528 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:44.448032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:44.510030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:44.517637 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e1556fe3-2156-4b35-8c0f-926759d63162 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.082787 Jul 27 16:38:44.518210 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 186/364] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:44 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:45.228126 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:45.228849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:45.235775 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:45.236299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:45.237187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:45.237711 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:45.380984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:45.389181 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:45.389383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:45.390202 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:45.390701 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:45.391867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1fd9f404-080c-43bb-a878-802fb886f2da tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.167862 Jul 27 16:38:45.392417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 179/365] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:45 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:45.397070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:45.397717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:45.398713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:45.399311 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:45.535049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:45.538612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:45.539236 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:45.542890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-65bd28ff-7701-413a-819f-da9782e68757 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.157525 Jul 27 16:38:45.544010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 187/366] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:45 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:45.546150 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:45.546602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:45.547379 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:45.547814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:45.609084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:45.616649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-00ece72e-c98d-4b79-a00b-059640b5190a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.081802 Jul 27 16:38:45.617237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 180/367] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:45 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:46.415647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:46.416294 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:46.427612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:46.428070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:46.428845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:46.429348 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:46.566816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:46.567378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:46.574920 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:46.575371 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:46.576209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:46.576834 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:46.578164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:46.587507 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:46.589672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:46.591254 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-10611c03-ce98-4aaa-b9ad-052826383318 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.179467 Jul 27 16:38:46.599802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 188/368] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:46 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:46.637948 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:46.638573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:46.645624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:46.646077 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:46.646869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:46.647302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:46.731697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:46.740789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2dd0c898-6eac-430c-8daa-175421210065 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.106267 Jul 27 16:38:46.741862 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 189/369] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:46 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:46.745781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:46.755758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3a5bba5c-d919-4d1e-92fb-96753eab9e42 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.192899 Jul 27 16:38:46.756762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 181/370] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:46 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:47.615621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:47.616241 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:47.623345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:47.623787 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:47.624544 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:47.625017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:47.760728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:47.767864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:47.768402 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:47.769206 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:47.769488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:47.770679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-25001cc6-135d-419d-b620-5836da087424 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.159013 Jul 27 16:38:47.771466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 190/371] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:47 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:47.787226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:47.787226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:47.787226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:47.787226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:47.791478 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:47.792095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:47.798039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:47.798485 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:47.799426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:47.799858 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:47.848825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:47.857095 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-79159c07-3166-4494-84f6-cb4d86588d55 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.093747 Jul 27 16:38:47.857716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 182/372] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:47 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:47.944235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:47.947594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:47.952481 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3629a641-ffa7-4630-8b12-ddd958d36e37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.164809 Jul 27 16:38:47.953067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 191/373] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:47 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:48.794364 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:48.794981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:48.804377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:48.804826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:48.805638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:48.806075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:48.878102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:48.878756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:48.885538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:48.886031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:48.887394 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:48.887902 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:48.959159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:48.968174 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ef1c1a93-f09c-4ecf-9f16-9369936cc239 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.094106 Jul 27 16:38:48.968841 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 192/374] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:48 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:48.974352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:48.977306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:48.978017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:48.983057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:48.984583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:48.985624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:48.985818 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f00f0160-38d3-4813-92b5-58bbaca04f37 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.195429 Jul 27 16:38:48.986159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:48.986493 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 183/375] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:48 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:48.987185 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:48.987715 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:49.124883 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:49.133351 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f56a0689-2228-4c9c-ba1e-b5f0f8ece4b3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.161435 Jul 27 16:38:49.133989 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 193/376] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:48 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:49.988458 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:49.989113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:49.996424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:49.996871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:49.997654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:49.998089 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:50.010554 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:50.011200 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:50.013581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=4 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:50.014240 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=16 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:50.020777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:50.021255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:50.022032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:50.022470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:50.061992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:50.069648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c06e7c16-79dd-4988-9d74-f7df3b0993e5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.085013 Jul 27 16:38:50.070226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 184/377] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:49 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:50.156340 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:50.156804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:50.157544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:50.159484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:50.165027 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:50.165608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:50.166060 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:50.166878 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:50.167016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:50.167315 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:50.168508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-66ee1802-b1f7-4739-90fe-399db3529c79 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.162032 Jul 27 16:38:50.169402 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 194/378] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:50 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:50.170205 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:50.298818 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:50.306191 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3cdf9224-1439-4797-a325-a478946d11df tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.154563 Jul 27 16:38:50.306750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 185/379] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:50 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:51.089755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:51.090634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:51.097122 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:51.097583 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:51.098339 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:51.098775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:51.170221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:51.177513 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-976cf92a-2eae-49d7-af91-1a3d6d359df4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.091612 Jul 27 16:38:51.178082 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 195/380] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:51 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:51.192238 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:51.192935 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:51.200045 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:51.200489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:51.201276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:51.201709 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:51.328148 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:51.328814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:51.330197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:51.335470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:51.335984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:51.336817 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:51.337356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:51.339047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:51.341582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:51.342981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-862a7661-d311-4b18-aab3-38e818aaf333 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.155055 Jul 27 16:38:51.343593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 186/381] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:51 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:51.473903 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:51.481971 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d1cfaaba-ecff-469c-9b51-ace6e4946a94 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.159325 Jul 27 16:38:51.482542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 196/382] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:51 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:52.199134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:52.199780 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:52.206606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:52.207056 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:52.207823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:52.208260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:52.269613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:52.278602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-042e1b0b-a4eb-46d8-95e1-5533a7314175 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1305 microversion: 2.1 time: 0.083357 Jul 27 16:38:52.279222 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 187/383] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:52 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1305 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:52.369447 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:52.370071 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:52.377446 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:52.377890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:52.378661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:52.379092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:52.502790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:52.503592 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:52.519756 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:52.520153 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:52.521261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:52.521526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:52.659423 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:52.667733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:52.669413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:52.670583 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7ae4af25-6eb4-46e1-a332-c382c41b9502 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.304990 Jul 27 16:38:52.671612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 197/384] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:52 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:52.794386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:52.801887 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7ee0f331-d593-4cc4-b9be-1b4e1e9462d5 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.302955 Jul 27 16:38:52.802438 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 188/385] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:52 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:53.301725 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:53.302355 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:53.316575 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:53.317324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:53.318633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:53.319132 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:53.410777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:53.418721 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a13a5631-b0d2-4647-8a45-12d4194021bb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1303 microversion: 2.1 time: 0.120806 Jul 27 16:38:53.419312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 198/386] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:53 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:53.694131 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:53.694642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:53.701513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:53.701963 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:53.702733 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:53.703173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:53.823142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:53.823866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:53.830346 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:53.830794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:53.831555 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:53.831986 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:53.843134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:53.851119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:53.852641 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:53.853830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-019ba3e9-b32e-4a5b-80cd-f04d6a474c87 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1744 microversion: 2.20 time: 0.163670 Jul 27 16:38:53.854388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 189/387] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:53 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:53.973326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:53.980609 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2a8e9464-43bd-451f-a7ae-e2a04905020d tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.161449 Jul 27 16:38:53.981201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 199/388] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:53 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:54.440610 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:54.441243 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:54.448051 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:54.448504 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:54.449313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:54.449750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:54.516295 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:54.526218 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d823b562-7bc0-4b92-a4d7-44802e1ae83b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1303 microversion: 2.1 time: 0.089695 Jul 27 16:38:54.526768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 190/389] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:54 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:54.878347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:54.880098 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:54.891517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:54.892406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:54.893502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:54.894468 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.001925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:55.003366 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:55.011944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.013230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.014272 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.014878 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.248469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:55.263215 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:55.265055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:55.266325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6ce7faba-d961-4926-b77f-1463fb29fa7d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1744 microversion: 2.20 time: 0.393573 Jul 27 16:38:55.267075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 200/390] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:54 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1744 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:55.289049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-785ebe15-5fc1-4f64-b98a-7d06f2cbbd21 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:55.296089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-785ebe15-5fc1-4f64-b98a-7d06f2cbbd21 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.296538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-785ebe15-5fc1-4f64-b98a-7d06f2cbbd21 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.365098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:55.373462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2dacfd0f-9ee8-42fd-95a8-a4a3578a7bac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.376034 Jul 27 16:38:55.373657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-785ebe15-5fc1-4f64-b98a-7d06f2cbbd21 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Going to try to stop instance {{(pid=124236) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 16:38:55.387311 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 191/391] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:54 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:55.425505 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-785ebe15-5fc1-4f64-b98a-7d06f2cbbd21 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action" status: 202 len: 0 microversion: 2.1 time: 0.139791 Jul 27 16:38:55.426395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 201/392] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:38:55 2022] POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:38:55.434607 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:55.436272 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:55.443192 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.443929 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.444971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.445574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.551223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:55.551992 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:55.558470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.558921 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.559705 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:55.560714 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:55.674208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:55.682214 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cf2bb1b2-e979-4191-9dd2-2a192abbb08e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1303 microversion: 2.1 time: 0.135720 Jul 27 16:38:55.682790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 202/393] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:55 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:55.778548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:55.786718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c8469147-f2c7-410f-96fd-b6f99c45fa88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.356056 Jul 27 16:38:55.787528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 192/394] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:55 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:56.290219 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:56.291019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:56.298504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.299027 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.299655 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.301142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.395332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:56.396628 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:56.407729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.410434 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.411600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.412119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.894578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:56.901516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:56.902978 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-de707e17-8893-4a6a-b980-538417bb225b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.512185 Jul 27 16:38:56.916248 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 193/395] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:56 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:56.916424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:56.916424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:56.916424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-75e41055-3962-459d-a75e-41bdc0f21d75 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1744 microversion: 2.20 time: 0.627501 Jul 27 16:38:56.921564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:56.922336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:56.924325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 203/396] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:56 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1744 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:56.929671 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:56.930410 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:56.933010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.933653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.934590 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.935776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.937783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.938314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:56.939251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:56.939718 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:57.233410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:57.242055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-41ffb51f-0bfe-4da5-a331-f0622188bf89 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.337331 Jul 27 16:38:57.243167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 194/397] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:56 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:57.248982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:57.264810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8ec0f41f-b4bf-4f47-80aa-0ac84bc77a75 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.339691 Jul 27 16:38:57.266345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 204/398] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:56 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:57.499585 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-0a9bec77-0081-4716-86fe-7ebc841a2ff8 req-d5f353db-7806-4e3f-bb05-1eb9c0641e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d821db-4106-4df9-9cec-c07b5b95e1e8", "tag": "0bef1170-4e15-46fb-94c9-cabca6dd7a80"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:57.510262 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0a9bec77-0081-4716-86fe-7ebc841a2ff8 req-d5f353db-7806-4e3f-bb05-1eb9c0641e28 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:57.510714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0a9bec77-0081-4716-86fe-7ebc841a2ff8 req-d5f353db-7806-4e3f-bb05-1eb9c0641e28 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:57.529207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-0a9bec77-0081-4716-86fe-7ebc841a2ff8 req-d5f353db-7806-4e3f-bb05-1eb9c0641e28 service nova] Creating event network-changed:0bef1170-4e15-46fb-94c9-cabca6dd7a80 for instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 on hv-cinder-84969 Jul 27 16:38:57.535693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-0a9bec77-0081-4716-86fe-7ebc841a2ff8 req-d5f353db-7806-4e3f-bb05-1eb9c0641e28 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040298 Jul 27 16:38:57.536496 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 195/399] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:57.925800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:57.926424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:57.933147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:57.933809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:57.934731 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:57.935326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:57.939806 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:57.940557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:57.949329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:57.949953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:57.951693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:57.952302 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:58.163648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:58.168269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:58.172185 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1af41f90-fe4b-4974-8a28-6e1a080f6065 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.250384 Jul 27 16:38:58.172749 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 205/400] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:57 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:58.177566 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:58.179428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:58.180718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-587ce4e0-f4ba-4a30-a9cf-6f470babec95 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.246131 Jul 27 16:38:58.181337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 196/401] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:57 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:38:58.263851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:58.264451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:58.271623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:58.272106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:58.272993 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:58.273501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:58.286254 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:58.286996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:58.293005 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:58.293459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:58.294229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:58.295246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:58.475349 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:58.485236 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b81692c3-acc8-4176-bd38-28dda2721b98 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.225920 Jul 27 16:38:58.486145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 206/402] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:58 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:58.488545 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:58.497120 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cbe40362-e0d2-4292-b08d-4ddffd39c110 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.214532 Jul 27 16:38:58.498235 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 197/403] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:58 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:38:58.547984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-5cc7f1a1-ec90-4a48-9630-d2a8aabd5629 req-31adec00-b7c6-46eb-b745-3c498c6d27cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c4ea75-9961-4644-8a94-8461f019fa5a", "name": "network-vif-plugged", "status": "completed", "tag": "c45f72a2-0106-4ad5-ab26-60fca9b2968b"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:38:58.558597 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-5cc7f1a1-ec90-4a48-9630-d2a8aabd5629 req-31adec00-b7c6-46eb-b745-3c498c6d27cb service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:58.559105 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-5cc7f1a1-ec90-4a48-9630-d2a8aabd5629 req-31adec00-b7c6-46eb-b745-3c498c6d27cb service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:58.570774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-5cc7f1a1-ec90-4a48-9630-d2a8aabd5629 req-31adec00-b7c6-46eb-b745-3c498c6d27cb service nova] Creating event network-vif-plugged:c45f72a2-0106-4ad5-ab26-60fca9b2968b for instance 17c4ea75-9961-4644-8a94-8461f019fa5a on hv-cinder-84969 Jul 27 16:38:58.575809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-5cc7f1a1-ec90-4a48-9630-d2a8aabd5629 req-31adec00-b7c6-46eb-b745-3c498c6d27cb service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032072 Jul 27 16:38:58.576384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 207/404] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:38:59.193041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:59.193651 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:59.200232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.200728 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.201523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.201957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.203893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:59.204622 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:59.211208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.211654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.212411 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.212840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.217321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:59.499159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:59.507312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:59.510269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-736250ff-674a-4e85-9098-86ad99168ea3 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.321033 Jul 27 16:38:59.521595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 198/405] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:59 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:59.524442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:59.526321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:59.527726 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0d924307-e1dd-4676-b614-d2eae2a99ee1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.328051 Jul 27 16:38:59.528500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 208/406] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:38:59 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:38:59.530990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:59.531751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:59.533897 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:38:59.534734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:38:59.537869 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.538518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.539478 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.540073 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.541586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.542131 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.543152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:38:59.543683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:38:59.786436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:59.796381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:38:59.799440 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bafde08e-c5b0-4834-b07d-90aa95d80432 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.276456 Jul 27 16:38:59.803597 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 199/407] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:59 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:38:59.819714 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0a437159-a65e-4d4d-8098-31fde502449e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.289882 Jul 27 16:38:59.820301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 209/408] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:38:59 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:00.536975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:00.537591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:00.547990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.548450 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.549265 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.549708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.558575 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:00.559269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:00.576833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.577463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.578373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.578896 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.757680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:00.770041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-774612c4-a609-448f-80fd-2ab5c86b8d4f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1318 microversion: 2.1 time: 0.236986 Jul 27 16:39:00.771061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 200/409] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:00 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:00.777302 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-ee24e4b6-301e-4b6d-b0da-be24ab43d009 req-f2ce6a77-489d-42b1-ac61-e12562b86859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "name": "network-vif-plugged", "status": "completed", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:00.792561 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ee24e4b6-301e-4b6d-b0da-be24ab43d009 req-f2ce6a77-489d-42b1-ac61-e12562b86859 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.793058 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ee24e4b6-301e-4b6d-b0da-be24ab43d009 req-f2ce6a77-489d-42b1-ac61-e12562b86859 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.793521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:00.802662 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:00.804177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:00.805376 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c034c4dd-a199-4b8e-b841-70c16bf2794e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.250671 Jul 27 16:39:00.808625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-ee24e4b6-301e-4b6d-b0da-be24ab43d009 req-f2ce6a77-489d-42b1-ac61-e12562b86859 service nova] Creating event network-vif-plugged:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:39:00.813303 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 210/410] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:00 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:00.823225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-ee24e4b6-301e-4b6d-b0da-be24ab43d009 req-f2ce6a77-489d-42b1-ac61-e12562b86859 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050748 Jul 27 16:39:00.826263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 201/411] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:00.843823 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:00.849516 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:00.850237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:00.853585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:00.861189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.861342 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.861641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.861772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.862410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.862516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:00.862841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:00.862944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:01.078094 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:01.081573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:01.086576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b8150936-cfb0-4efd-aab5-ef73dcb40ba9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.241045 Jul 27 16:39:01.101025 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-011d003a-bfdc-4bc8-b2c9-8715eb2cae6c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.254388 Jul 27 16:39:01.102199 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 202/412] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:00 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:01.105747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 211/413] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:00 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:01.791247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:01.792699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:01.799980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:01.800570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:01.801455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:01.801957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:01.806250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:01.833454 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:01.834063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:01.841069 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:01.841570 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:01.842502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:01.843070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:02.013626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:02.022632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-95ab01a0-55ef-4c7b-8f94-79cbc54ed125 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1507 microversion: 2.1 time: 0.235091 Jul 27 16:39:02.037708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 203/414] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:01 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:02.051539 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:02.062076 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:02.063973 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:02.065287 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c03f1854-a01f-4f17-99e0-772da741025f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.236205 Jul 27 16:39:02.071259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 212/415] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:01 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:02.111644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:02.117103 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:02.117805 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:02.121241 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:02.130256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:02.131698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:02.132220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:02.133223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:02.133714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:02.134229 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:02.135105 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:02.136470 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:02.374279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:02.384297 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1bf92712-dbc2-44d9-815d-eb18eaad88ca tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.269692 Jul 27 16:39:02.385963 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 213/416] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:02 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:02.400481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:02.410751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5883a108-5078-4090-be25-50dc1b87f986 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.304324 Jul 27 16:39:02.412313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 204/417] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:02 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:03.092812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:03.093442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:03.101931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:03.102635 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:03.103574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:03.104123 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:03.261734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:03.272172 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:03.273854 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:03.275112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8f5d0627-5352-428e-8066-6c7e89e41000 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.186508 Jul 27 16:39:03.282953 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 214/418] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:03 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:03.405895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:03.406686 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:03.416402 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:03.416849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:03.417677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:03.418107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:03.438904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:03.439429 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:03.445721 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:03.446403 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:03.447380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:03.448242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:03.677036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:03.680793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:03.695576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b7c113fa-fd1e-4741-be25-1dc2428cabfc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.260988 Jul 27 16:39:03.712927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-990de93a-21af-4dff-b058-ae418aad8ea4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.309388 Jul 27 16:39:03.716841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 205/419] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:03 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:03.729492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 215/420] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:03 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:04.298325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:04.298941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:04.314399 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.314851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:04.315682 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.316075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:04.502606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:04.514416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:04.515793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-185b9142-8e62-4f1c-a7e8-8bb756077ef1 req-fe3cd1f6-f3fd-4d58-b397-13a7411e5682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d821db-4106-4df9-9cec-c07b5b95e1e8", "name": "network-vif-plugged", "status": "completed", "tag": "0bef1170-4e15-46fb-94c9-cabca6dd7a80"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:04.516333 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:04.517659 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9a47e00a-72cc-46ed-abd4-ad7b92770681 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.223384 Jul 27 16:39:04.518644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 206/421] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:04 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:04.526994 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-185b9142-8e62-4f1c-a7e8-8bb756077ef1 req-fe3cd1f6-f3fd-4d58-b397-13a7411e5682 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.527432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-185b9142-8e62-4f1c-a7e8-8bb756077ef1 req-fe3cd1f6-f3fd-4d58-b397-13a7411e5682 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:04.541201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-185b9142-8e62-4f1c-a7e8-8bb756077ef1 req-fe3cd1f6-f3fd-4d58-b397-13a7411e5682 service nova] Creating event network-vif-plugged:0bef1170-4e15-46fb-94c9-cabca6dd7a80 for instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 on hv-cinder-84969 Jul 27 16:39:04.547491 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-185b9142-8e62-4f1c-a7e8-8bb756077ef1 req-fe3cd1f6-f3fd-4d58-b397-13a7411e5682 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039777 Jul 27 16:39:04.549656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 216/422] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:39:04.718673 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:04.719685 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:04.728201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.728652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:04.730225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.730841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:04.738262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:04.739357 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:04.757648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.758501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:04.759586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:04.760295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:05.014340 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:05.025501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8a12b191-362c-40a2-a329-a605cdefafce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.291511 Jul 27 16:39:05.038121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 217/423] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:04 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:05.050587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:05.059392 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bae4974b-ec21-414e-875f-22382458c1af tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.345406 Jul 27 16:39:05.060747 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 207/424] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:04 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:05.541426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:05.547235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:05.554409 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:05.555047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:05.555986 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:05.556424 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:05.725233 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:05.734118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:05.735826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:05.737175 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6bb742fa-2b5b-4d05-86ff-e2342ce6242d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.199727 Jul 27 16:39:05.738200 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 218/425] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:05 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:06.049921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:06.051237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:06.061263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:06.062013 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:06.062985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:06.063611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:06.081355 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:06.082471 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:06.092785 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:06.093630 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:06.094622 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:06.095498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:06.259902 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:06.269990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-821c84ff-0893-4f06-b701-6518f1734d74 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1371 microversion: 2.1 time: 0.223997 Jul 27 16:39:06.271216 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 208/426] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:06 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:06.310068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:06.319445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d35af858-c20a-4985-aad5-37658363f0c1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.242082 Jul 27 16:39:06.320028 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 219/427] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:06 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:06.765426 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:06.766050 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:06.773211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:06.773811 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:06.774601 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:06.775036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:06.954556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:06.964709 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:06.967449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:06.968968 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ff7b9cab-ebf5-4ac0-b7ca-fd1e30da9a5f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.209169 Jul 27 16:39:06.969536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 209/428] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:06 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:07.291435 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:07.292621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:07.301224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:07.301802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:07.302914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:07.303586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:07.341988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:07.342785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:07.351005 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:07.356198 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:07.358201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:07.366250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:07.553533 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:07.563929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2083a2bc-cc2b-4e31-ac70-1118e84b2c30 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1565 microversion: 2.1 time: 0.276062 Jul 27 16:39:07.564508 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 220/429] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:07 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1565 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:07.579655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:07.585684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:07.586504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:07.590610 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ccba76da-94ca-43b4-88e7-46034a5ebb10 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.252929 Jul 27 16:39:07.595933 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 210/430] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:07 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:07.598462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:07.599092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:07.601017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:07.601017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:07.697382 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-54e4ef22-d084-4cc8-bdea-0e03f83c6f6d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114886 Jul 27 16:39:07.697382 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 221/431] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:39:07 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:07.996413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:07.999924 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:08.039242 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:08.039721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:08.041174 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:08.041615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:08.194587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:08.203939 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:08.207619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:08.208906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-de4cf86d-5db3-463a-9a03-0a57642dda3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.219055 Jul 27 16:39:08.212738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 211/432] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:07 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:08.613591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:08.614935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:08.629846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:08.630600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:08.631698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:08.632254 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:08.790135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:08.800859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3cd04262-be21-4a6d-9560-7037d9b0d800 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.191832 Jul 27 16:39:08.801959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 222/433] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:08 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:08.835228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-aa59143c-2464-4ea7-b91c-9bb6b23cf3ce req-31c53c9a-8f65-4a7e-9577-c565d75d3fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d821db-4106-4df9-9cec-c07b5b95e1e8", "tag": "0bef1170-4e15-46fb-94c9-cabca6dd7a80"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:08.849207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-aa59143c-2464-4ea7-b91c-9bb6b23cf3ce req-31c53c9a-8f65-4a7e-9577-c565d75d3fd0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:08.849652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-aa59143c-2464-4ea7-b91c-9bb6b23cf3ce req-31c53c9a-8f65-4a7e-9577-c565d75d3fd0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:08.862283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-aa59143c-2464-4ea7-b91c-9bb6b23cf3ce req-31c53c9a-8f65-4a7e-9577-c565d75d3fd0 service nova] Creating event network-changed:0bef1170-4e15-46fb-94c9-cabca6dd7a80 for instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 on hv-cinder-84969 Jul 27 16:39:08.868301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-aa59143c-2464-4ea7-b91c-9bb6b23cf3ce req-31c53c9a-8f65-4a7e-9577-c565d75d3fd0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036727 Jul 27 16:39:08.869034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 212/434] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:09.236812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:09.237776 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:09.243872 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:09.244356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:09.245151 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:09.245585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:09.416121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:09.426305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:09.427812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:09.429033 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f70f4c74-dc92-4f31-8a0c-53e7bcfeafb7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1739 microversion: 2.20 time: 0.196199 Jul 27 16:39:09.429596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 223/435] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:09 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:09.823964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:09.824975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:09.833105 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:09.833861 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:09.834975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:09.835622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:10.116816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:10.125374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a22b2844-81bf-4e36-918f-e26d0b874e9d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.305985 Jul 27 16:39:10.125939 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 213/436] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:09 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:10.457314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:10.458009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:10.464407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:10.464854 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:10.465648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:10.466923 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:10.601368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:10.609680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:10.611476 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:10.612636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b8d83004-3814-47e8-ae87-6e8977b7442d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1721 microversion: 2.20 time: 0.159837 Jul 27 16:39:10.613207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 224/437] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:10 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:11.147299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:11.147817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:11.155059 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:11.155505 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:11.156270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:11.156727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:11.288285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:11.296326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-26e9faaa-4e70-4a3b-a8ca-5146b251d50c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.152982 Jul 27 16:39:11.296910 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 214/438] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:11 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:11.636649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:11.637282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:11.643952 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:11.644398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:11.645181 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:11.645612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:11.781976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:11.785593 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:11.791328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:11.792825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:11.794004 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-05220815-4713-451e-b875-96024562f294 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1721 microversion: 2.20 time: 0.161499 Jul 27 16:39:11.795139 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 225/439] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:11 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:12.317134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:12.317688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:12.320031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=84 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:12.326242 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:12.326683 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:12.327495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:12.327937 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:12.442962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-0411e584-320e-4748-9bd4-f746a8df7299 req-6739fe52-b5be-4d86-8225-97431bc7d533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "name": "network-vif-unplugged", "status": "completed", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:12.455605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-0411e584-320e-4748-9bd4-f746a8df7299 req-6739fe52-b5be-4d86-8225-97431bc7d533 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:12.456072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-0411e584-320e-4748-9bd4-f746a8df7299 req-6739fe52-b5be-4d86-8225-97431bc7d533 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:12.462435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:12.470642 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-0411e584-320e-4748-9bd4-f746a8df7299 req-6739fe52-b5be-4d86-8225-97431bc7d533 service nova] Creating event network-vif-unplugged:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:39:12.472619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fb9f1734-39ee-42b2-af8f-d1fb7ec77cd2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.159394 Jul 27 16:39:12.485853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-0411e584-320e-4748-9bd4-f746a8df7299 req-6739fe52-b5be-4d86-8225-97431bc7d533 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038545 Jul 27 16:39:12.485853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 226/440] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:12.487444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 215/441] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:12 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:12.817665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:12.818353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:12.825062 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:12.825532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:12.826280 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:12.826709 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:12.961812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:12.971236 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:12.972769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:12.973951 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-79ce8fe3-8158-4f93-a52a-ae769a7ed6bf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1724 microversion: 2.20 time: 0.160572 Jul 27 16:39:12.974505 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 227/442] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:12 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:12.997799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "345c9ba6-80e2-4456-8ffd-a2ca8929dd8d"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:13.000316 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:13.006591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.007039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.007814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.008257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.305378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fdf2ab41-a55d-49fd-852d-8cac3af21609 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311868 Jul 27 16:39:13.306120 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 216/443] 10.222.0.74 () {62 vars in 1364 bytes} [Wed Jul 27 16:39:12 2022] POST /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:39:13.431765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:13.432295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:13.434260 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=88 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:13.440536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.441008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.441771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.442234 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.485569 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124236) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 16:39:13.494874 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:13.495491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:13.502962 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.503462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.504234 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.504679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.555142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-95776339-7fcb-4b05-b7a6-482cd0443745 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/action" status: 202 len: 0 microversion: 2.20 time: 0.127261 Jul 27 16:39:13.555952 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 228/444] 10.222.0.74 () {62 vars in 1319 bytes} [Wed Jul 27 16:39:13 2022] POST /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:39:13.564929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:13.567511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:13.571860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.572298 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.573162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:13.573601 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:13.702781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:13.705619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:13.720243 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6c92beeb-7f4c-4614-8a01-333defca8fdc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.229126 Jul 27 16:39:13.720951 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 217/445] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:13 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:13.741650 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:13.750664 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:13.752144 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:13.753308 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ae2301c2-b00c-463c-a231-f462f91bd8eb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1750 microversion: 2.20 time: 0.193409 Jul 27 16:39:13.753853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 229/446] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:13 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1750 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:14.742947 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:14.743674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:14.751745 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:14.752201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:14.753018 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:14.753467 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:14.776812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:14.777458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:14.785047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:14.785542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:14.786319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:14.786752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:14.973363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:14.977218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:14.981289 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-90b47d22-7f09-42ce-a9d4-acea26007e8d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.242979 Jul 27 16:39:14.981859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 218/447] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:14 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:14.985659 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:14.987174 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:14.988322 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-49768f77-2f79-4c8d-9570-488b6ce71012 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1752 microversion: 2.20 time: 0.215608 Jul 27 16:39:14.988864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 230/448] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:14 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:16.003587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:16.004301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:16.010980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:16.011513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:16.012348 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:16.013586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:16.014381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:16.015009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:16.021713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:16.022154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:16.022918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:16.023666 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:16.222900 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:16.227066 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:16.231296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1b4c3a95-92ff-4774-a1fa-61eeef1b448e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.231542 Jul 27 16:39:16.231874 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 219/449] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:15 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:16.237022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:16.238966 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:16.240167 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-65bfa6ba-4c2b-4f71-bbc0-76bc0ee1e045 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.230181 Jul 27 16:39:16.241135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 231/450] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:16 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:17.252408 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:17.253054 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:17.260210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:17.260748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:17.261615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:17.262119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:17.263540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:17.264156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:17.270859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:17.271544 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:17.272494 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:17.273134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:17.479118 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:17.486337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:17.492055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-31b36e3b-b74b-4bde-8034-84c41afe8c35 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.243491 Jul 27 16:39:17.493034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 220/451] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:17 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:17.498514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:17.500301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:17.501711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6dab6e7b-aad1-41d0-8f7f-f68b26dda5c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.241823 Jul 27 16:39:17.502255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 232/452] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:17 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:18.516072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:18.516797 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:18.523693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:18.524384 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:18.525379 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:18.525971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:18.531277 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:18.535335 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:18.539262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:18.539825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:18.540669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:18.541223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:18.737506 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:18.749297 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93c4c89d-9a8e-4d38-937e-1f691f61eebb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.237679 Jul 27 16:39:18.750285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 221/453] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:18 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:18.763700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:18.776300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:18.777814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:18.779565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d6d108ac-a837-4bb9-b2e2-c96fd4aff35b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.255054 Jul 27 16:39:18.782605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 233/454] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:18 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:19.771559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:19.772179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:19.779795 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:19.780573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:19.781458 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:19.781964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:19.802801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:19.804065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:19.811140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:19.811589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:19.812356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:19.812787 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:20.006631 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:20.010285 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:20.016403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8615b874-b9e6-4646-b1e2-5677dfdfe384 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.248834 Jul 27 16:39:20.019569 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 222/455] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:19 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:20.019712 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:20.021217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:20.022373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3219bf54-ebaa-448b-8db0-1b7f05eef7c4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.223513 Jul 27 16:39:20.022900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 234/456] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:19 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:21.039194 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:21.039885 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:21.045457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:21.046626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:21.046762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:21.047148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:21.047923 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:21.048716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:21.053113 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:21.053552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:21.054308 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:21.054734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:21.268802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:21.275641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:21.277897 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-709ab6e0-1237-44dd-8e9b-698258306f88 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.242525 Jul 27 16:39:21.278609 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 223/457] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:21 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:21.284111 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:21.285645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:21.287005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-602fcb5b-6e46-4e0b-8da3-60ffc2f279e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.245479 Jul 27 16:39:21.287857 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 235/458] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:21 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:21.795844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d48090e-b3e7-4b94-938c-de7744c5c64c", "device": "/dev/sdb"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:21.798883 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:21.805088 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:21.805537 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:21.806622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:21.807061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:22.299717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:22.300456 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:22.307010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:22.307446 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:22.308213 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:22.308644 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:22.445448 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:22.454695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-969533df-0569-41fa-8c47-3316ba5d8848 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.158787 Jul 27 16:39:22.455387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 236/459] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:22 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:22.463721 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:22.464353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:22.471809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:22.472683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:22.473713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:22.474230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:22.615055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:22.624522 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:22.627283 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:22.628452 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a38dae0b-0c17-486f-b679-4a63ee600a68 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.168460 Jul 27 16:39:22.629033 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 237/460] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:22 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:23.475640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:23.476391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:23.483711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:23.484384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:23.485197 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:23.485634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:23.622936 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:23.635220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-030b27b3-ebea-4d06-af17-80b2cb150fdf tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.163492 Jul 27 16:39:23.635803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 238/461] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:23 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:23.661350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:23.661957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:23.668187 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:23.668636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:23.669423 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:23.669858 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:23.817121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:23.826971 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:23.828475 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:23.829684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-68fd5d6b-0ca8-49d0-bf93-d9b23d5d292f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.172165 Jul 27 16:39:23.830236 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 239/462] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:23 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:24.665863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:24.666590 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:24.673034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:24.673480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:24.674237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:24.674665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:24.809541 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:24.817732 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5f7b8936-5ee1-475d-a3fb-e5872ae33fb1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.158035 Jul 27 16:39:24.818302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 240/463] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:24 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:24.852719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:24.854624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:24.861385 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:24.861855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:24.862801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:24.863243 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:24.999802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:25.008875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:25.010342 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:25.011534 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9b28ffb4-4285-4218-b6df-7e977ff27110 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.162803 Jul 27 16:39:25.012094 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 241/464] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:24 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:25.839543 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:25.840334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:25.847073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:25.847514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:25.848273 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:25.848700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:25.852833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:25.991863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:26.001800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fbe91319-9ebc-489b-a69b-2a5e39efa49b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.165984 Jul 27 16:39:26.002381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 242/465] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:25 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:26.035706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:26.036305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:26.042316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:26.043417 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:26.044146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:26.044577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:26.179862 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:26.191768 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:26.193295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:26.194461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-14f1aa26-e029-4440-a564-4bfb402dab3b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.163112 Jul 27 16:39:26.195008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 243/466] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:26 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:27.023875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:27.025159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:27.031160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:27.031604 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:27.032366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:27.032794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:27.171411 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:27.180018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f4095b2c-c521-4151-93f2-72f71a13791e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1724 microversion: 2.1 time: 0.160505 Jul 27 16:39:27.180590 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 244/467] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:27 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:27.217833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:27.218443 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:27.224466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:27.224939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:27.225700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:27.226135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:27.356226 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:27.365008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:27.366468 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:27.367622 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-67d39898-070d-4734-955e-7e64669b32b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.153855 Jul 27 16:39:27.368167 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 245/468] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:27 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:28.202304 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:28.202917 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:28.209838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.210280 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.211032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.211463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.338734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:28.346934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bb9961ae-97f1-4740-badf-097ea69e9bac tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1701 microversion: 2.1 time: 0.148480 Jul 27 16:39:28.347492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 246/469] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:28 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:28.366623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d63b8d7e-65ca-4503-9294-5920f956c635 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:28.372401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d63b8d7e-65ca-4503-9294-5920f956c635 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.372842 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d63b8d7e-65ca-4503-9294-5920f956c635 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.394719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d63b8d7e-65ca-4503-9294-5920f956c635 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Going to try to start instance {{(pid=124236) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 16:39:28.433539 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d63b8d7e-65ca-4503-9294-5920f956c635 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action" status: 202 len: 0 microversion: 2.1 time: 0.070195 Jul 27 16:39:28.434052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 247/470] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:39:28 2022] POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 16:39:28.439486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:28.440174 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:28.446362 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.446807 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.447566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.447995 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.579800 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:28.588251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:28.589779 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:28.592576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e2470a9e-7aae-42cf-8580-df906d78e84f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.157308 Jul 27 16:39:28.593384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 248/471] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:28 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:28.597856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:28.598534 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:28.604773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.605255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.606020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:28.606457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:28.734065 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:28.742464 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-29473dd7-583c-4165-a8f1-8ffe89af4ea8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1710 microversion: 2.1 time: 0.148337 Jul 27 16:39:28.743026 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 249/472] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:28 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:28.897189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-216a9276-b436-442f-bc01-be3335279e14 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "POST /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.106077 Jul 27 16:39:28.898201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 224/473] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:39:21 2022] POST /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a/os-volume_attachments => generated 194 bytes in 7108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:29.616492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:29.617061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:29.623673 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:29.624118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:29.624877 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:29.626026 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:29.763003 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:29.764592 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:29.765334 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:29.771369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:29.772917 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:29.773276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:29.774085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a7d24926-0eb8-4129-9d8a-ae1cab33b4f2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.161879 Jul 27 16:39:29.774412 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:29.775059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 250/474] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:29 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:29.782999 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:29.783570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:29.924115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:29.932444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f4055257-f8fb-4813-bbf6-92fb0cc6f107 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1710 microversion: 2.1 time: 0.172568 Jul 27 16:39:29.933055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 225/475] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:29 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:30.799568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:30.800102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:30.806882 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:30.807319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:30.808069 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:30.808494 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:30.941796 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:30.950626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:30.951556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:30.952742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8fe15cf8-dc67-4ad0-a9df-6e5905456f46 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.157717 Jul 27 16:39:30.958666 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 251/476] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:30 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:30.963160 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:30.963765 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:30.971277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:30.971721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:30.972470 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:30.972918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:31.106793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:31.115332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2fb3819a-c071-48e8-8bc2-faaf4a9f0feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1714 microversion: 2.1 time: 0.155859 Jul 27 16:39:31.116110 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 226/477] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:30 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:31.979813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:31.980426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:31.986995 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:31.987442 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:31.988199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:31.988637 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:32.124925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:32.135903 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:32.137678 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:32.138844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-369550bb-48b3-4bfa-8c76-02c7211035b4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.162917 Jul 27 16:39:32.139385 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 252/478] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:31 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:33.164274 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:33.164949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:33.171596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:33.172079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:33.172840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:33.173301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:33.307810 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:33.317190 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:33.318695 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:33.319848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3d3713d0-de21-4c91-b13b-85e7ca35a8e2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.159935 Jul 27 16:39:33.320398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 227/479] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:33 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:34.345186 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:34.345820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:34.352218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:34.352661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:34.353456 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:34.353893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:34.491106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:34.499501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:34.501036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:34.502183 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1aecdb8e-41af-4a49-927e-7680dc0395c0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.162814 Jul 27 16:39:34.502730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 253/480] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:34 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:35.525229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:35.525871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:35.533107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:35.533557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:35.534323 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:35.534761 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:35.667997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:35.676782 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:35.678336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:35.679480 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b327f5b2-30a1-4d06-acd9-f37aa1e064fd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.158198 Jul 27 16:39:35.680021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 228/481] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:35 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:36.704086 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:36.704697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:36.711324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:36.711772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:36.712533 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:36.712992 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:36.846843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:36.857134 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:36.858626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:36.860386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-00d4f3ee-8934-4f56-9b2a-db5ee521b653 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.160231 Jul 27 16:39:36.860958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 254/482] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:36 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:37.883531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:37.884137 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:37.890730 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:37.891177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:37.891936 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:37.892374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:38.025351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:38.034299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:38.035813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:38.037000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-32d88658-1b85-4b85-a9d4-bbaa7e13b048 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.157309 Jul 27 16:39:38.037554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 229/483] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:37 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:39.060959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:39.061574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:39.068145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:39.068709 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:39.070059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:39.070810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:39.206432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:39.214889 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:39.216647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:39.217824 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5bd09acc-23a8-4aef-9ef2-6c7f00e2c384 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.160819 Jul 27 16:39:39.218402 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 255/484] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:39 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:39.956849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:39.957428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:39.964142 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:39.964608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:39.965453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:39.965927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:39.989216 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8c17f18b-f2eb-4fc6-b234-1095cc39eba1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/ips" status: 200 len: 150 microversion: 2.1 time: 0.036792 Jul 27 16:39:39.989706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 230/485] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:39:39 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:40.002191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17ceef98-d4fa-4678-962c-d7fce744e437"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:40.004792 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:40.010776 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.011230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.011987 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.012421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.092711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Invalid volume: volume 17ceef98-d4fa-4678-962c-d7fce744e437 is already attached to instances: c7fb7d3a-2581-4c62-9d19-7636961df56e Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: POST /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/os-volume_attachments HTTP/1.1 Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 74 Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:39:40.095334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {"volumeAttachment": {"volumeId": "17ceef98-d4fa-4678-962c-d7fce744e437"}} Jul 27 16:39:40.096867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Invalid volume: volume 17ceef98-d4fa-4678-962c-d7fce744e437 is already attached to instances: c7fb7d3a-2581-4c62-9d19-7636961df56e Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'server_id': '6b72f0b5-a0b5-458b-9cbb-7216d34be718', 'body': {'volumeAttachment': {'volumeId': '17ceef98-d4fa-4678-962c-d7fce744e437'}}} Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17ceef98-d4fa-4678-962c-d7fce744e437 is already attached to instances: c7fb7d3a-2581-4c62-9d19-7636961df56e Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:40.097740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17ceef98-d4fa-4678-962c-d7fce744e437 is already attached to instances: c7fb7d3a-2581-4c62-9d19-7636961df56e Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:40.098856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17ceef98-d4fa-4678-962c-d7fce744e437 is already attached to instances: c7fb7d3a-2581-4c62-9d19-7636961df56e Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 400 to user: Invalid volume: volume 17ceef98-d4fa-4678-962c-d7fce744e437 is already attached to instances: c7fb7d3a-2581-4c62-9d19-7636961df56e {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-51c3a87a-51e6-49e1-85f9-f22a9eb3c92c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099917 Jul 27 16:39:40.099991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 256/486] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:39:39 2022] POST /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:39:40.105830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:40.106325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:40.112353 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.112800 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.113599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.114032 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.141471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:39:40.201432 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:40.233322 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ad50206e-c493-4b48-8407-ffdfe701e6ab tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 204 len: 0 microversion: 2.1 time: 0.130955 Jul 27 16:39:40.233927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 231/487] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:39:40 2022] DELETE /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:39:40.242241 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:40.244031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:40.246860 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:40.247719 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:40.252178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.252938 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.253801 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.254198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.254332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.254981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:40.255409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.255668 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:40.456842 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:40.459909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:40.463366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:40.465369 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5736685-51bd-4e49-8a8a-fc3e2edf5fb2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1682 microversion: 2.1 time: 0.222880 Jul 27 16:39:40.465979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 232/488] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:40 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:40.470742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:40.472319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:40.473490 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7e7ae4de-3cee-48b4-ab28-fe8cc2b056e0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.235259 Jul 27 16:39:40.474020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 257/489] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:40 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:41.305658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-02316b30-8364-475b-9384-827f80a818c2 req-c4083132-4f4f-409f-a915-629f0a9f081e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "name": "network-vif-plugged", "status": "completed", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:41.316854 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-02316b30-8364-475b-9384-827f80a818c2 req-c4083132-4f4f-409f-a915-629f0a9f081e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:41.317381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-02316b30-8364-475b-9384-827f80a818c2 req-c4083132-4f4f-409f-a915-629f0a9f081e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:41.329409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-02316b30-8364-475b-9384-827f80a818c2 req-c4083132-4f4f-409f-a915-629f0a9f081e service nova] Creating event network-vif-plugged:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:39:41.334097 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-02316b30-8364-475b-9384-827f80a818c2 req-c4083132-4f4f-409f-a915-629f0a9f081e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Jul 27 16:39:41.334677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 233/490] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:41.489356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:41.489958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:41.497885 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:41.498356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:41.499118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:41.499549 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:41.501091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:41.502851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:41.512580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:41.513230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:41.514061 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:41.514502 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:41.703326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:41.707412 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:41.711057 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6677da02-6a69-466e-978b-20fa1d21c089 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1682 microversion: 2.1 time: 0.227289 Jul 27 16:39:41.711719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 258/491] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:41 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:41.715880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:41.717684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:41.718835 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6017559d-d525-4b53-990a-857124eb69a4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.222363 Jul 27 16:39:41.719374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 234/492] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:41 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:42.731628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:42.732246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:42.739604 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:42.740054 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:42.740843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:42.741306 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:42.741429 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:42.741991 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:42.744439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:42.749864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:42.750318 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:42.751090 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:42.751525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:42.938757 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:42.941880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:42.946506 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8363f972-99fc-4183-b30d-9331b1462fbe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1682 microversion: 2.1 time: 0.218778 Jul 27 16:39:42.947075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 259/493] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:42 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:42.950596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:42.952181 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:42.953468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a99b465d-787a-40ef-a018-6d82b7684e93 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.215916 Jul 27 16:39:42.954096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 235/494] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:42 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:43.967786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:43.968431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:43.970738 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:43.975574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:43.976084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:43.976208 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:43.976536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:43.977345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:43.977786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:43.982848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:43.983308 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:43.984074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:43.985054 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:44.169102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:44.173429 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:44.178123 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d3ef8407-1cb8-40ae-a49c-7c05069c56d4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1682 microversion: 2.1 time: 0.214388 Jul 27 16:39:44.178715 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 260/495] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:43 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:44.182231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:44.183747 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:44.184916 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-29126951-c554-4550-98a7-3bf2574d4a94 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.213257 Jul 27 16:39:44.185464 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 236/496] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:43 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:45.199294 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:45.199895 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:45.206814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:45.207258 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:45.208014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:45.208149 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:45.208991 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:45.209137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:45.217076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:45.217807 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:45.218617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:45.219246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:45.478442 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:45.483015 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:45.487950 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:45.489557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:45.490965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2bba6c91-56b1-47a6-9327-916c8552d935 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.287083 Jul 27 16:39:45.491199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e4ff3883-f691-4f6c-9839-b391b50dd341 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1682 microversion: 2.1 time: 0.295493 Jul 27 16:39:45.491713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 237/498] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:45 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:39:45.491910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 261/498] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:45 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1682 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:45.821689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-a6e6ccbd-626f-408b-90fb-c2955c13853f req-14e0ecad-07ec-4c46-98a8-f2a5311c5a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b72f0b5-a0b5-458b-9cbb-7216d34be718", "name": "network-vif-deleted", "tag": "48f4dc5d-66f7-4d76-acfc-3857b17ffa1e"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:45.831096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-a6e6ccbd-626f-408b-90fb-c2955c13853f req-14e0ecad-07ec-4c46-98a8-f2a5311c5a18 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:45.831542 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-a6e6ccbd-626f-408b-90fb-c2955c13853f req-14e0ecad-07ec-4c46-98a8-f2a5311c5a18 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:45.845588 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-a6e6ccbd-626f-408b-90fb-c2955c13853f req-14e0ecad-07ec-4c46-98a8-f2a5311c5a18 service nova] Creating event network-vif-deleted:48f4dc5d-66f7-4d76-acfc-3857b17ffa1e for instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 on hv-cinder-84969 Jul 27 16:39:45.850846 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-a6e6ccbd-626f-408b-90fb-c2955c13853f req-14e0ecad-07ec-4c46-98a8-f2a5311c5a18 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032664 Jul 27 16:39:45.851753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 238/499] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:46.525102 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:46.526959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:46.527709 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:46.528706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:46.542832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:46.543734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:46.544312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:46.544820 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:46.545791 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:46.547611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:46.548170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:46.548662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:46.603023 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:46.603689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:46.604410 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lazy-loading 'fault' on Instance uuid 6b72f0b5-a0b5-458b-9cbb-7216d34be718 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:39:46.673672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:46.683256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d66a1759-bb82-463a-8db9-851332e8dbf2 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 200 len: 1332 microversion: 2.1 time: 0.173374 Jul 27 16:39:46.684530 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 262/500] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:46 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 1332 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:46.803436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:46.815113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:46.819112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:46.820606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-427059db-3431-4a58-b8db-3ca27d8b752c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1808 microversion: 2.20 time: 0.309672 Jul 27 16:39:46.822748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 239/501] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:46 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:47.704106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:47.704717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:47.711261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:47.711709 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:47.712495 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:47.712987 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:47.729865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 HTTP/1.1 Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:39:47.731395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:39:47.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '6b72f0b5-a0b5-458b-9cbb-7216d34be718'} Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:39:47.734328 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:39:47.735925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:39:47.737345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:39:47.737345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9391c9ea-bd28-4070-a3a0-7bf6ee66e5ed tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 404 len: 111 microversion: 2.1 time: 0.033289 Jul 27 16:39:47.737345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 263/502] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:47 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:39:47.742010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-53cc6157-8ffc-44f0-b65a-4446bd7bdecb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '.version_select at 0x7ff56c4bd3a0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:47.761556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-53cc6157-8ffc-44f0-b65a-4446bd7bdecb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862658022" status: 202 len: 0 microversion: 2.1 time: 0.023336 Jul 27 16:39:47.762292 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 240/503] 10.222.0.74 () {58 vars in 1221 bytes} [Wed Jul 27 16:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862658022 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:39:47.846016 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:47.846565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:47.852615 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:47.853102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:47.853891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:47.854488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:48.072733 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:48.081962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:48.083495 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:48.084626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d812efa1-524a-450c-aa7c-042582ec7e0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1795 microversion: 2.20 time: 0.242563 Jul 27 16:39:48.085208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 264/504] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:39:47 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1795 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:39:48.397627 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:48.398124 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:48.404684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:48.405151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:48.405914 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:48.407000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:48.533247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lazy-loading 'services' on Instance uuid 17c4ea75-9961-4644-8a94-8461f019fa5a {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:39:48.655556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8712ee5c-8773-4a81-b702-781dfd011331 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "DELETE /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a/os-volume_attachments/7d48090e-b3e7-4b94-938c-de7744c5c64c" status: 202 len: 0 microversion: 2.1 time: 0.261730 Jul 27 16:39:48.656636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 241/505] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:39:48 2022] DELETE /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a/os-volume_attachments/7d48090e-b3e7-4b94-938c-de7744c5c64c => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:39:48.739348 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:48.739886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:48.746683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:48.747332 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:48.748131 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:48.748587 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:48.880910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lazy-loading 'services' on Instance uuid c7fb7d3a-2581-4c62-9d19-7636961df56e {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:39:48.992546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2b4abab3-e2ac-453c-88c9-5b6cf3b49547 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments/17ceef98-d4fa-4678-962c-d7fce744e437" status: 202 len: 0 microversion: 2.1 time: 0.257022 Jul 27 16:39:48.993152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 265/506] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:39:48 2022] DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments/17ceef98-d4fa-4678-962c-d7fce744e437 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:39:49.002889 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:49.005200 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:49.011979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:49.012427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:49.013220 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:49.013657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:49.045388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6653af1f-3d4c-4167-8f6b-39fcd2d1cf1c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Jul 27 16:39:49.045946 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 242/507] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:39:48 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:49.786323 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:49.786907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:49.793846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:49.794293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:49.795058 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:49.795492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:49.820821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:39:49.899915 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-84f5f463-d889-434d-995d-44bace38c004 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "DELETE /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 204 len: 0 microversion: 2.1 time: 0.118459 Jul 27 16:39:49.900670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 266/508] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:39:49 2022] DELETE /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:39:49.909578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:49.910448 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:49.916613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:49.917129 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:49.917942 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:49.918454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:50.050463 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:50.058068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-91a0ee5f-17d6-482b-a586-226c8f858474 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1513 microversion: 2.1 time: 0.152998 Jul 27 16:39:50.058391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:50.058598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 243/509] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:49 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:50.060732 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:50.067269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:50.067712 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:50.068469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:50.068921 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:50.098090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e09cdf8a-bf1e-4c32-b39f-e006c20f4b0b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Jul 27 16:39:50.098626 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 267/510] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:39:50 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:39:51.079752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:51.080342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:51.086862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:51.087304 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:51.088052 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:51.088481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:51.109327 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:51.112161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:51.118833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:51.119283 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:51.120044 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:51.120480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:51.153224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9e984cab-e7dc-41de-8f4c-26c8b68cc2ac tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047758 Jul 27 16:39:51.154153 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 268/511] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:39:51 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:39:51.227515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:51.235148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a83341cd-1242-4660-8299-a3f3431697b7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1513 microversion: 2.1 time: 0.159285 Jul 27 16:39:51.235701 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 244/512] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:51 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:52.165377 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:52.167585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:52.174992 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.175436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.176197 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.176624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.208237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-138abcc7-5f09-4555-9ed6-d9ef2f1a92f3 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046924 Jul 27 16:39:52.208794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 269/513] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:39:52 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:39:52.255884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:52.256499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:52.263072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.263521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.264280 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.264714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.271401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:52.271967 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:52.278644 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.278644 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.279209 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.279701 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.305512 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:39:52.357576 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:52.387421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0e62228d-7a56-4447-b3cf-37777637ee76 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 204 len: 0 microversion: 2.1 time: 0.119304 Jul 27 16:39:52.388238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 270/514] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:39:52 2022] DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:39:52.396814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:52.397762 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:52.405595 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.406560 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.407336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.407768 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.502351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:52.510446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-79b15e03-e9ec-4b99-b41a-c70f87be90cb tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1513 microversion: 2.1 time: 0.258294 Jul 27 16:39:52.511005 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 245/515] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:52 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:52.612514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:52.619895 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e7e7b5cf-136c-47be-8682-d9bfd3eb8d06 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1683 microversion: 2.1 time: 0.227335 Jul 27 16:39:52.620452 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 271/516] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:52 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:39:52.723578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-fb4621f1-e63c-41fe-94bc-e52224e3bbca req-bb262117-f569-4bb5-8e02-dd1139fb7fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c4ea75-9961-4644-8a94-8461f019fa5a", "name": "network-vif-deleted", "tag": "c45f72a2-0106-4ad5-ab26-60fca9b2968b"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:52.733140 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-fb4621f1-e63c-41fe-94bc-e52224e3bbca req-bb262117-f569-4bb5-8e02-dd1139fb7fc0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:52.733576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-fb4621f1-e63c-41fe-94bc-e52224e3bbca req-bb262117-f569-4bb5-8e02-dd1139fb7fc0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:52.744626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-fb4621f1-e63c-41fe-94bc-e52224e3bbca req-bb262117-f569-4bb5-8e02-dd1139fb7fc0 service nova] Creating event network-vif-deleted:c45f72a2-0106-4ad5-ab26-60fca9b2968b for instance 17c4ea75-9961-4644-8a94-8461f019fa5a on hv-cinder-84969 Jul 27 16:39:52.749580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-fb4621f1-e63c-41fe-94bc-e52224e3bbca req-bb262117-f569-4bb5-8e02-dd1139fb7fc0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Jul 27 16:39:52.750845 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 246/517] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:53.532344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:53.532976 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:53.539509 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:53.539947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:53.540752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:53.541211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:53.601688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:53.609127 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-156f5165-2ed1-48e9-bd14-6da58319aaab tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1471 microversion: 2.1 time: 0.081161 Jul 27 16:39:53.609693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 272/518] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:53 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1471 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:53.642224 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:53.642941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:53.649557 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:53.650003 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:53.650769 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:53.651200 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:53.782291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:53.789988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-590a377c-7da2-4b2b-8c96-0f506d7c806f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1683 microversion: 2.1 time: 0.152390 Jul 27 16:39:53.790491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 247/519] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:53 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:54.630407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:54.631014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:54.637429 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:54.637865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:54.638613 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:54.639037 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:54.668948 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:54.669379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:54.669820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lazy-loading 'fault' on Instance uuid 17c4ea75-9961-4644-8a94-8461f019fa5a {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:39:54.711448 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:54.719182 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-46bfbfd6-8312-4a66-abae-9b6db5e4bfe8 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 200 len: 1308 microversion: 2.1 time: 0.092579 Jul 27 16:39:54.719958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 273/520] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:54 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:54.812691 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:54.814104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:54.821239 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:54.821953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:54.822974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:54.823410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:55.052319 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:55.059736 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-849686dc-9bcf-416c-9e44-531b1419f4dd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1683 microversion: 2.1 time: 0.252346 Jul 27 16:39:55.060298 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 248/521] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:54 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:55.691630 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-34e40bbb-2afa-4c79-8ed7-3ec90799fbeb req-abaeeaab-6a43-4b10-8183-203feaebb270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fb7d3a-2581-4c62-9d19-7636961df56e", "name": "network-vif-deleted", "tag": "78e696af-c295-41c4-a3bd-e88439dd705f"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:55.702512 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-34e40bbb-2afa-4c79-8ed7-3ec90799fbeb req-abaeeaab-6a43-4b10-8183-203feaebb270 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:55.702947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-34e40bbb-2afa-4c79-8ed7-3ec90799fbeb req-abaeeaab-6a43-4b10-8183-203feaebb270 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:55.716367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-34e40bbb-2afa-4c79-8ed7-3ec90799fbeb req-abaeeaab-6a43-4b10-8183-203feaebb270 service nova] Creating event network-vif-deleted:78e696af-c295-41c4-a3bd-e88439dd705f for instance c7fb7d3a-2581-4c62-9d19-7636961df56e on hv-cinder-84969 Jul 27 16:39:55.721462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-34e40bbb-2afa-4c79-8ed7-3ec90799fbeb req-abaeeaab-6a43-4b10-8183-203feaebb270 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035180 Jul 27 16:39:55.722044 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 274/522] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:55.743116 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:55.743757 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 17c4ea75-9961-4644-8a94-8461f019fa5a] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:55.755998 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:55.756447 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:55.757253 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:55.757694 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:55.791139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] HTTP exception thrown: Instance 17c4ea75-9961-4644-8a94-8461f019fa5a could not be found. Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Request method failure captured: Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a HTTP/1.1 Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WoJ3axjcXbL9UQUT-ff4EoxeN3FsPQUA_Jv_znrIdPgjmwu6CAotasvs8hoxQbvE8mQVqeplmZTMAMe1faHuzRpcRX9CaAIH5_fALyiHb4aA8ftwVajUJLQ-vqOiZe6YsONhKa2GzCRAfaXLrdT7k_NFlHsCDhAt9iVneUtbv-uIPU Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ce1f193c68ef49b78c95c02f7413b7d6 Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-216872814 Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:39:55.793233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotTestJSON-216872814 Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ce1f193c68ef49b78c95c02f7413b7d6 Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-216872814 Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotTestJSON-216872814-project Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 00f17de515184c01a73c454c7f0b7e70 Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotTestJSON-216872814-project Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 17c4ea75-9961-4644-8a94-8461f019fa5a could not be found. Jul 27 16:39:55.794509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '17c4ea75-9961-4644-8a94-8461f019fa5a'} Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c4ea75-9961-4644-8a94-8461f019fa5a could not be found. Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:39:55.795246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c4ea75-9961-4644-8a94-8461f019fa5a could not be found. Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c4ea75-9961-4644-8a94-8461f019fa5a could not be found. Jul 27 16:39:55.796349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:55.799949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Returning 404 to user: Instance 17c4ea75-9961-4644-8a94-8461f019fa5a could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:39:55.799949 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3bc8f0ce-17eb-4ef8-ba98-fa1162e6218a tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a" status: 404 len: 111 microversion: 2.1 time: 0.057051 Jul 27 16:39:55.800468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 249/523] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:55 2022] GET /compute/v2.1/servers/17c4ea75-9961-4644-8a94-8461f019fa5a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:39:56.082840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:56.083542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:56.090029 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:56.090485 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:56.091256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:56.091944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:56.127890 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:56.128344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:56.128794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lazy-loading 'fault' on Instance uuid c7fb7d3a-2581-4c62-9d19-7636961df56e {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:39:56.182873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:39:56.191122 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-534b2683-7975-4421-95cb-63b8c7bcaded tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 200 len: 1332 microversion: 2.1 time: 0.113138 Jul 27 16:39:56.191692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 275/524] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:56 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:39:57.212435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:57.213076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:39:57.220869 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:57.221343 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:57.222107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:57.222542 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:57.235688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e HTTP/1.1 Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:39:57.237233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:39:57.240750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c7fb7d3a-2581-4c62-9d19-7636961df56e'} Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:39:57.241714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:39:57.243071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:39:57.244245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:39:57.244245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-07247822-1410-4c50-a391-b1b312425be4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 404 len: 111 microversion: 2.1 time: 0.029979 Jul 27 16:39:57.244245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 250/525] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:39:57 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:39:57.247605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-49da7e24-8587-42c4-8cc9-180021041b07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '.version_select at 0x7ff56cbe8550>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:39:57.288780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-49da7e24-8587-42c4-8cc9-180021041b07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599923766" status: 202 len: 0 microversion: 2.1 time: 0.044830 Jul 27 16:39:57.289311 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 276/526] 10.222.0.74 () {58 vars in 1221 bytes} [Wed Jul 27 16:39:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599923766 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:39:57.923143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-071cf1c8-43b5-4704-bdaa-6dd2988b9cfc tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: .version_select at 0x7ff56c51ff70>, body: {"keypair": {"name": "tempest-keypair-462249426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3BXQryaRMn1LaBwEqg4JX+at56/bHVLqSKz8GEVpTIxEQ20lS9QDywC4WU+QGCsoCBbybPE0qp4TAuaA9PcgZKz4WXAIsxHQ7mNEQ4rSluSJvT2QbaI7/yOtM2HveGxA=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:57.938608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-071cf1c8-43b5-4704-bdaa-6dd2988b9cfc tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:39:57.942361 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-071cf1c8-43b5-4704-bdaa-6dd2988b9cfc tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:39:57.962662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-071cf1c8-43b5-4704-bdaa-6dd2988b9cfc tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050589 Jul 27 16:39:57.963237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 251/527] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:39:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:39:59.462302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1292505499", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22edebd8-fe29-44cb-9c58-64fe5ac1da5e"}], "security_groups": [{"name": "tempest-securitygroup--1452028371"}], "key_name": "tempest-keypair-462249426", "user_data": "}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:39:59.564124 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] validate_networks() for [('22edebd8-fe29-44cb-9c58-64fe5ac1da5e', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:39:59.926042 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:39:59.926463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:39:59.926963 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:39:59.927367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:39:59.927773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:39:59.936751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:59.937272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:59.938217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:39:59.938657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:39:59.955693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:39:59.959593 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:39:59.971031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:39:59.973289 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:40:00.018761 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9fbbcd1e-1c04-475d-98cf-25f8f03379af tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561202 Jul 27 16:40:00.019652 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 277/528] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:39:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:40:00.031391 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-780acf1d-3e8d-4413-b19c-7828d341688b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:00.032007 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-780acf1d-3e8d-4413-b19c-7828d341688b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:00.084179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-780acf1d-3e8d-4413-b19c-7828d341688b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:00.091980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-780acf1d-3e8d-4413-b19c-7828d341688b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1241 microversion: 2.1 time: 0.065196 Jul 27 16:40:00.092769 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 252/529] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:00 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:01.114089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:01.114960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:01.121514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:01.122169 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:01.122950 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:01.123612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:01.195961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:01.204061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-edbfbd8f-fe92-455f-b157-5146c066432a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1311 microversion: 2.1 time: 0.095021 Jul 27 16:40:01.205269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 278/530] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:01 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:02.226373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:02.226989 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:02.233427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:02.233875 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:02.234636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:02.235072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:02.360653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:02.368021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7a2b690d-62d7-4a1b-be75-3e45cac8525a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.145519 Jul 27 16:40:02.368570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 253/531] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:02 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:02.729221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-5eefedb2-3e0a-43e9-aaeb-26f6b1b8647c req-d2558a6a-9265-4838-a07f-7757a879642a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21a1ed6-5d26-46b1-8222-4b4fb534abb5", "tag": "81cf0807-eaaf-44b0-aea5-82674b4921d7"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:02.739507 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-5eefedb2-3e0a-43e9-aaeb-26f6b1b8647c req-d2558a6a-9265-4838-a07f-7757a879642a service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:02.740033 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-5eefedb2-3e0a-43e9-aaeb-26f6b1b8647c req-d2558a6a-9265-4838-a07f-7757a879642a service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:02.752450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-5eefedb2-3e0a-43e9-aaeb-26f6b1b8647c req-d2558a6a-9265-4838-a07f-7757a879642a service nova] Creating event network-changed:81cf0807-eaaf-44b0-aea5-82674b4921d7 for instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 on hv-cinder-84969 Jul 27 16:40:02.757627 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-5eefedb2-3e0a-43e9-aaeb-26f6b1b8647c req-d2558a6a-9265-4838-a07f-7757a879642a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033446 Jul 27 16:40:02.758551 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 279/532] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:03.388866 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:03.389462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:03.396363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:03.396813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:03.397602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:03.398037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:03.400641 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:03.527347 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:03.535192 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0be55f25-9f17-43f9-9197-58ef7d37070b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.150257 Jul 27 16:40:03.535758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 254/533] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:03 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:04.556461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:04.557406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:04.564074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:04.564518 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:04.565309 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:04.565742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:04.692119 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:04.699434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-23a2ef03-dcf3-4063-9da3-53e06eb732f0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.147609 Jul 27 16:40:04.699999 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 280/534] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:04 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:05.720751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:05.721377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:05.728381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:05.728861 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:05.729674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:05.730109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:05.805798 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1081809328", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "networks": [{"uuid": "bf03c05d-0ec2-48e8-8d9f-dc0e8a2213ab"}]}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:05.859774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] validate_networks() for [('bf03c05d-0ec2-48e8-8d9f-dc0e8a2213ab', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:40:05.869376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:05.877178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c08f81d0-4d25-49d4-9e5f-44fabcf85f29 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.161269 Jul 27 16:40:05.877772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 255/535] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:05 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:06.453071 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:40:06.453499 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:40:06.454016 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:40:06.454431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:40:06.454869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:40:06.465473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:06.465918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:06.467020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:06.467486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:06.484310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Getting quotas for project ce1f193c68ef49b78c95c02f7413b7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:40:06.488220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Getting quotas for user 00f17de515184c01a73c454c7f0b7e70 and project ce1f193c68ef49b78c95c02f7413b7d6. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:40:06.501469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:40:06.503869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:40:06.552067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-510b3cdf-0055-4fa8-9895-8a201fafe6f0 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750054 Jul 27 16:40:06.552705 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 281/536] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 16:40:06.563443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-82aa403d-7b28-4292-afe7-9f1b4ce2ea1e tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:06.564569 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-82aa403d-7b28-4292-afe7-9f1b4ce2ea1e tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:06.615937 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-82aa403d-7b28-4292-afe7-9f1b4ce2ea1e tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:06.622591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-82aa403d-7b28-4292-afe7-9f1b4ce2ea1e tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1219 microversion: 2.1 time: 0.063066 Jul 27 16:40:06.623180 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 256/537] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:06 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:06.899045 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:06.899863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:06.906977 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:06.908105 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:06.908926 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:06.909378 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:07.050129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:07.057895 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d790db46-44c0-4fcb-a23c-9c0f8c691c65 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.163728 Jul 27 16:40:07.058453 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 282/538] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:06 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:07.093905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295c7811-cec3-428c-ac50-dd16d4adb781"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:07.096945 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:07.104170 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:07.104624 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:07.105437 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:07.105881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:07.644767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:07.645951 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:07.656202 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:07.657280 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:07.658613 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:07.659643 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:07.691053 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4e9600b6-7cda-4004-b86c-89f9004f8626 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601573 Jul 27 16:40:07.694568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 257/539] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:40:07 2022] POST /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:07.813145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:07.822046 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d95ac028-9d4f-48c3-a35e-e29f3dfd97c7 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1279 microversion: 2.1 time: 0.181814 Jul 27 16:40:07.822564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 283/540] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:07 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:08.085543 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:08.086707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:08.093650 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:08.094203 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:08.095666 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:08.096309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:08.325363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:08.334631 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-eda04ead-ccfd-48f0-bda6-dfcd040cce6c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.253282 Jul 27 16:40:08.337335 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 258/541] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:08 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:08.845107 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:08.845696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:08.852461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:08.852930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:08.853730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:08.854385 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:09.074574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:09.082108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-32f93a3a-e813-4aef-9634-1dd0a9629550 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.242565 Jul 27 16:40:09.082640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 284/542] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:08 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:09.203799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-57e76246-9537-4f69-8aac-24a704365fda req-66ecbd86-ae06-4588-817c-4988b58a69ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6f3001-062e-4a77-9e1d-2632c24f4c23", "tag": "a75b09be-0816-4dc9-9913-572323c73645"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:09.216578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-57e76246-9537-4f69-8aac-24a704365fda req-66ecbd86-ae06-4588-817c-4988b58a69ce service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:09.217495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-57e76246-9537-4f69-8aac-24a704365fda req-66ecbd86-ae06-4588-817c-4988b58a69ce service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:09.230251 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-57e76246-9537-4f69-8aac-24a704365fda req-66ecbd86-ae06-4588-817c-4988b58a69ce service nova] Creating event network-changed:a75b09be-0816-4dc9-9913-572323c73645 for instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 on hv-cinder-84969 Jul 27 16:40:09.234984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-57e76246-9537-4f69-8aac-24a704365fda req-66ecbd86-ae06-4588-817c-4988b58a69ce service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034994 Jul 27 16:40:09.235744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 259/543] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:09.355625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:09.356266 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:09.361348 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:09.364064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:09.364514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:09.365349 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:09.365790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:09.581793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:09.589933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cc00a2ff-68df-465c-b884-b02b02cdfee0 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.238245 Jul 27 16:40:09.590501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 285/544] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:09 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:09.980117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-d466fb45-37ec-4535-a54e-db03f4de7831 req-4091d70e-ec52-4a58-962a-adc68d7330f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21a1ed6-5d26-46b1-8222-4b4fb534abb5", "name": "network-vif-plugged", "status": "completed", "tag": "81cf0807-eaaf-44b0-aea5-82674b4921d7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:09.990651 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-d466fb45-37ec-4535-a54e-db03f4de7831 req-4091d70e-ec52-4a58-962a-adc68d7330f5 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:09.991103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-d466fb45-37ec-4535-a54e-db03f4de7831 req-4091d70e-ec52-4a58-962a-adc68d7330f5 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:10.002525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-d466fb45-37ec-4535-a54e-db03f4de7831 req-4091d70e-ec52-4a58-962a-adc68d7330f5 service nova] Creating event network-vif-plugged:81cf0807-eaaf-44b0-aea5-82674b4921d7 for instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 on hv-cinder-84969 Jul 27 16:40:10.007286 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-d466fb45-37ec-4535-a54e-db03f4de7831 req-4091d70e-ec52-4a58-962a-adc68d7330f5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Jul 27 16:40:10.007934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 260/545] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:10.103365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:10.103972 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:10.110476 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:10.110917 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:10.111662 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:10.112088 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:10.239405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:10.246700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-27589565-b059-4fff-81c9-8d1a3b493d86 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.147146 Jul 27 16:40:10.247261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 286/546] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:10 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:10.612027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:10.612824 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:10.621891 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:10.622348 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:10.623136 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:10.623710 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:10.841152 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:10.848931 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b99e8753-27ee-4bfe-b840-04260febf59d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.241205 Jul 27 16:40:10.849485 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 261/547] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:10 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:11.267915 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:11.268506 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:11.275158 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:11.275610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:11.276374 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:11.276805 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:11.402584 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:11.409859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d129b7bd-143a-4347-84d9-ad139dbe16a1 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.146490 Jul 27 16:40:11.410421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 287/548] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:11 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:11.870164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:11.870773 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:11.877383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:11.877831 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:11.878585 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:11.879022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:12.012728 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:12.025109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a4b1d541-7bd4-4010-9fd6-6079c6ab4334 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1367 microversion: 2.1 time: 0.156790 Jul 27 16:40:12.025109 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 262/549] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:11 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:12.430387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:12.430995 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:12.437909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:12.438431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:12.439399 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:12.439834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:12.580635 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:12.588179 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-803737d4-950c-4647-a10d-42e15399a3ac tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.161611 Jul 27 16:40:12.588752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 288/550] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:12 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:13.046052 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:13.047430 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:13.051056 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:13.058003 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:13.058507 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:13.059264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:13.059700 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:13.199979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:13.207401 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d80bf302-a5ae-403f-99dd-d72a02e9951b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1557 microversion: 2.1 time: 0.166118 Jul 27 16:40:13.207965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 263/551] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:13 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:13.227343 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:13.227836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:13.233752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:13.234194 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:13.234944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:13.235917 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:13.311608 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-38939607-23e9-49ce-8916-eb9f7678e86e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088012 Jul 27 16:40:13.312190 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 289/552] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:40:13 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:13.609907 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:13.611168 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:13.617374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:13.617816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:13.618611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:13.619039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:13.844367 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:13.863587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5ec5c6df-89c7-40b2-aa99-cd93c4672c3f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.257658 Jul 27 16:40:13.864175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 264/553] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:13 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:14.007680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-48198d5c-0dd2-4a5e-8e91-9e48e3d898d0 req-24cebeed-d0c8-49fc-9b7e-83a9b6709fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6f3001-062e-4a77-9e1d-2632c24f4c23", "name": "network-vif-plugged", "status": "completed", "tag": "a75b09be-0816-4dc9-9913-572323c73645"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:14.023054 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-48198d5c-0dd2-4a5e-8e91-9e48e3d898d0 req-24cebeed-d0c8-49fc-9b7e-83a9b6709fe0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:14.023836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-48198d5c-0dd2-4a5e-8e91-9e48e3d898d0 req-24cebeed-d0c8-49fc-9b7e-83a9b6709fe0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:14.040713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-48198d5c-0dd2-4a5e-8e91-9e48e3d898d0 req-24cebeed-d0c8-49fc-9b7e-83a9b6709fe0 service nova] Creating event network-vif-plugged:a75b09be-0816-4dc9-9913-572323c73645 for instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 on hv-cinder-84969 Jul 27 16:40:14.047808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-48198d5c-0dd2-4a5e-8e91-9e48e3d898d0 req-24cebeed-d0c8-49fc-9b7e-83a9b6709fe0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043793 Jul 27 16:40:14.048699 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 290/554] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:14.637218 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-3ed34ff4-aa34-459d-b6e2-6a92cbff4f0f req-0507bd9f-f828-47bd-ac27-6daf45b5c05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21a1ed6-5d26-46b1-8222-4b4fb534abb5", "tag": "81cf0807-eaaf-44b0-aea5-82674b4921d7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:14.647059 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-3ed34ff4-aa34-459d-b6e2-6a92cbff4f0f req-0507bd9f-f828-47bd-ac27-6daf45b5c05b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:14.647495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-3ed34ff4-aa34-459d-b6e2-6a92cbff4f0f req-0507bd9f-f828-47bd-ac27-6daf45b5c05b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:14.658567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-3ed34ff4-aa34-459d-b6e2-6a92cbff4f0f req-0507bd9f-f828-47bd-ac27-6daf45b5c05b service nova] Creating event network-changed:81cf0807-eaaf-44b0-aea5-82674b4921d7 for instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 on hv-cinder-84969 Jul 27 16:40:14.663849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-3ed34ff4-aa34-459d-b6e2-6a92cbff4f0f req-0507bd9f-f828-47bd-ac27-6daf45b5c05b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030383 Jul 27 16:40:14.664423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 265/555] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:14.885211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:14.886020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:14.893006 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:14.893446 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:14.894486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:14.894930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:14.915496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:15.058225 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:15.065855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-655c4127-dfe8-4a09-9a6f-0cf2cbfd7b37 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.185775 Jul 27 16:40:15.066418 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 291/556] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:14 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:15.275768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:15.278113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:15.284796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:15.285278 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:15.286049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:15.286489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:15.308728 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'flavor' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:15.440642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b87f1b97-a4b4-4aa8-abdf-b8f417f3d589 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/action" status: 200 len: 32 microversion: 2.1 time: 0.169290 Jul 27 16:40:15.441285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 266/557] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:40:15 2022] POST /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:40:15.450645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:15.451281 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:15.467965 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:15.468417 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:15.469229 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:15.470322 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:15.646220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:15.654735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b93e768b-73c8-4f0c-aeb9-727b564eea7b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.207868 Jul 27 16:40:15.655841 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 292/558] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:15 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:16.088287 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:16.088928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:16.095427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:16.095877 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:16.096647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:16.097284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:16.243091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:16.253086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-82d34002-8b36-46fd-bfb1-4220d2a0b6db tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1319 microversion: 2.1 time: 0.169624 Jul 27 16:40:16.253821 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 267/559] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:16 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:16.675520 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:16.676163 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:16.679538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=4 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:16.680191 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=12 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:16.685011 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:16.685483 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:16.686270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:16.686708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:16.820959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:16.829197 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0dbd558e-d3be-49d7-8c1e-4fe1126129f2 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.157508 Jul 27 16:40:16.829812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 293/560] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:16 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:17.275009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:17.275728 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:17.277814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=8 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:17.283937 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:17.284384 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:17.285207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:17.285666 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:17.411413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:17.418899 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-095e6c19-282c-4baa-a4ec-5eeb78cfdf7f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1508 microversion: 2.1 time: 0.148093 Jul 27 16:40:17.419398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 268/561] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:17 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:17.439431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe89271d-3895-4185-ad25-4807d78fb1cc", "device": "/dev/sdb"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:17.442282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:17.448179 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:17.448617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:17.449391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:17.449819 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:17.683979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b5497e1f-2931-4318-99fd-7d1a0198706b tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "POST /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248671 Jul 27 16:40:17.684627 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 294/562] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:40:17 2022] POST /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:17.850722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:17.851343 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:17.857419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:17.857902 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:17.858693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:17.859133 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:17.992031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:18.000201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0e7bdb7d-6f2a-4d9f-a8af-c58cd8615779 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.153264 Jul 27 16:40:18.001348 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 269/563] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:17 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:19.023847 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:19.024478 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:19.030848 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:19.031314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:19.032068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:19.032500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:19.163636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:19.171742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-002a40ea-a629-4217-abe5-8378e2abc4c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.152872 Jul 27 16:40:19.172300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 295/564] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:19 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:20.196922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:20.197559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:20.204836 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:20.205298 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:20.206057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:20.206484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:20.222326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:20.355553 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:20.363941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fb7a93c4-3b40-4a57-bdfa-77b3285672ed tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.174083 Jul 27 16:40:20.364501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 270/565] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:20 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:21.384656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:21.385296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:21.392295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:21.392730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:21.393518 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:21.393944 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:21.519809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:21.527738 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-45bff476-4b6c-4606-a2fd-3f9d3ab79f9d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.146866 Jul 27 16:40:21.528291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 296/566] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:21 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:22.061383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:22.061886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:22.069050 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:22.069506 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:22.070274 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:22.070711 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:22.151967 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'services' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:22.235221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-77cc201b-760f-49e9-9f6c-6dcc1c6ea122 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-volume_attachments/c3ddd635-9518-48a7-b908-a0f20eac0ad4" status: 202 len: 0 microversion: 2.1 time: 0.178789 Jul 27 16:40:22.235806 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 271/567] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:40:22 2022] DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-volume_attachments/c3ddd635-9518-48a7-b908-a0f20eac0ad4 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:40:22.550161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:22.550775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:22.557639 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:22.558088 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:22.558863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:22.559297 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:22.700143 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:22.708833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a8a1cdd4-bc37-4560-9aa5-5753c5c58bc1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.163098 Jul 27 16:40:22.709521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 297/568] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:22 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:23.732372 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:23.733138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:23.740008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:23.740460 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:23.741259 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:23.741698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:23.874828 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:23.883232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8b8d52ed-13f2-4c70-a0bc-7bc70eb26b71 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.155606 Jul 27 16:40:23.883785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 272/569] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:23 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:24.904724 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:24.905363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:24.912432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:24.912904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:24.913673 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:24.914101 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:25.045867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:25.053676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7fb420f0-a1a3-4098-83ad-5901b62691eb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.152793 Jul 27 16:40:25.054228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 298/570] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:24 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:25.462257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e1ee7fff-fc9a-43c8-9b7c-bf598419309b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:25.469113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1ee7fff-fc9a-43c8-9b7c-bf598419309b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:25.469559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1ee7fff-fc9a-43c8-9b7c-bf598419309b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:25.529431 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e1ee7fff-fc9a-43c8-9b7c-bf598419309b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Going to try to stop instance {{(pid=124235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 16:40:25.571154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e1ee7fff-fc9a-43c8-9b7c-bf598419309b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action" status: 202 len: 0 microversion: 2.1 time: 0.112568 Jul 27 16:40:25.571738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 273/571] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:40:25 2022] POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 16:40:25.580371 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:25.581031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:25.586899 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:25.587330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:25.588075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:25.588500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:25.719909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:25.727332 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dda5c7bc-52ad-4186-9c3b-cb41abf24bca tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.151377 Jul 27 16:40:25.727878 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 299/572] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:25 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:26.075016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:26.075721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:26.082671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:26.083129 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:26.083896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:26.084337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:26.213861 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:26.222076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7b0d5dc9-9d10-431e-b55d-688a489c7be5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.151365 Jul 27 16:40:26.222635 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 274/573] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:26 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:26.748878 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:26.749527 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:26.756767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:26.757250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:26.758012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:26.758449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:26.889415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:26.896847 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-841db8a4-34f2-4e06-bf0a-b071c013f130 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.151943 Jul 27 16:40:26.897445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 300/574] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:26 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:27.243037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:27.243643 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:27.250097 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:27.251159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:27.251918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:27.252352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:27.382638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:27.390574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-55e7bb1d-b78a-4350-ac0e-6764ac46db76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.151361 Jul 27 16:40:27.391129 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 275/575] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:27 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:27.917474 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:27.917995 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:27.925282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:27.925756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:27.926522 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:27.926980 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:28.054415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:28.061986 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-395f4454-d84e-4f11-ae5e-3d1392c0a74b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.148480 Jul 27 16:40:28.062546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 301/576] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:27 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:28.411776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:28.412391 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:28.418950 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:28.419339 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:28.420104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:28.420541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:28.561707 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:28.570111 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-26e8bf6f-9921-4364-b09a-521bbbde3242 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.162241 Jul 27 16:40:28.570668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 276/577] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:28 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:29.083935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:29.084527 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:29.091646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:29.092372 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:29.093280 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:29.093736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:29.225605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:29.232997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7cfce3c1-8813-400b-8645-0a776c92bec3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.153517 Jul 27 16:40:29.233546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 302/578] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:29 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:29.591523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:29.592424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:29.599294 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:29.599814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:29.600626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:29.601096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:29.730831 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:29.739195 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b66a5804-b7e8-4561-a6ac-a27e034cfb81 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.151489 Jul 27 16:40:29.739742 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 277/579] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:29 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:30.254444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:30.255053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:30.261519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:30.261959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:30.262717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:30.263147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:30.391312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:30.399131 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5add7ccf-1248-4d12-98af-f97bd69fb507 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.149135 Jul 27 16:40:30.399772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 303/580] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:30 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:30.761048 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:30.761587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:30.768640 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:30.769117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:30.769884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:30.770318 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:30.898342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:30.906577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bb0b9797-9b70-47e2-a899-5e1696209025 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.149365 Jul 27 16:40:30.907867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 278/581] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:30 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:31.419559 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:31.420116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:31.427221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:31.427671 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:31.428432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:31.428871 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:31.560480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:31.568566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f2ca0dcd-8ea1-4d88-9b14-e2fcdcaec073 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.152888 Jul 27 16:40:31.569147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 304/582] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:31 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:31.928833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:31.929474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:31.935916 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:31.936364 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:31.937148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:31.937579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.065661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:32.073711 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-063f74b2-ce1e-4140-ba3e-248ccf6e6107 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.148683 Jul 27 16:40:32.074265 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 279/583] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:31 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:32.590408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:32.591060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:32.597771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.598215 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.599056 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.599488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.717365 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:32.717880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:32.723918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.724365 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.725163 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.725599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.735956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:32.743628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0f46fa88-ca2b-4d9d-9811-c7ea5f1cdb23 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.157223 Jul 27 16:40:32.744197 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 305/584] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:32 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:32.754647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-707139b4-9f8d-4d06-8b08-58ceab33024c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments/345c9ba6-80e2-4456-8ffd-a2ca8929dd8d" status: 200 len: 194 microversion: 2.20 time: 0.041522 Jul 27 16:40:32.755219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 280/585] 10.222.0.74 () {60 vars in 1454 bytes} [Wed Jul 27 16:40:32 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments/345c9ba6-80e2-4456-8ffd-a2ca8929dd8d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:40:32.820350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:32.820839 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:32.826641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.827084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.827827 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.828255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.902665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:32.907329 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lazy-loading 'services' on Instance uuid a008e56d-969e-442a-bb08-524ee7e06084 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:32.979463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-02bf10da-7d50-4404-b286-27df74286a06 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments/345c9ba6-80e2-4456-8ffd-a2ca8929dd8d" status: 202 len: 0 microversion: 2.20 time: 0.162789 Jul 27 16:40:32.980045 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 306/586] 10.222.0.74 () {60 vars in 1457 bytes} [Wed Jul 27 16:40:32 2022] DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments/345c9ba6-80e2-4456-8ffd-a2ca8929dd8d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:40:32.989028 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:32.991294 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:32.997887 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.998342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:32.999119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:32.999552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:33.037798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1cf1992a-4130-449d-bb3e-1af12ff6d9bd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053129 Jul 27 16:40:33.038288 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 281/587] 10.222.0.74 () {60 vars in 1343 bytes} [Wed Jul 27 16:40:32 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:40:33.096172 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:33.096880 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:33.103101 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:33.103642 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:33.104408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:33.104846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:33.234199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:33.242726 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-466418a3-3d72-4f93-80c1-6bc1f75ac6c5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.151502 Jul 27 16:40:33.243330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 307/588] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:33 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:33.765531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:33.766639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:33.772542 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:33.773027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:33.774366 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:33.774823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:33.906250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:33.914524 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-852550e5-a8cd-4abb-8e5f-65b7d5908dab tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.152765 Jul 27 16:40:33.915071 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 282/589] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:33 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:34.051397 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:34.053748 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:34.060139 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:34.060575 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:34.061356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:34.061790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:34.090840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0d784503-975d-4cd8-a800-3f0be23209b6 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044153 Jul 27 16:40:34.091389 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 308/590] 10.222.0.74 () {60 vars in 1343 bytes} [Wed Jul 27 16:40:34 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 16:40:34.264055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:34.264673 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:34.271983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:34.272466 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:34.273254 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:34.273691 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:34.403624 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:34.411820 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c1e840fb-28e7-44de-8c62-57614380c638 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.151821 Jul 27 16:40:34.412381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 283/591] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:34 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:34.935296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:34.935906 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:34.942036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:34.942565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:34.943333 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:34.943768 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:35.071649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:35.079685 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-474d9a41-1202-4c8f-9a2f-2b54936ea776 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.148166 Jul 27 16:40:35.080238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 309/592] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:34 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:35.103664 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:35.105977 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:35.111940 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:35.112387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:35.113213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:35.113638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:35.142043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-646c66c8-4187-4db6-b69d-47490bc9242e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042423 Jul 27 16:40:35.142587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 284/593] 10.222.0.74 () {60 vars in 1343 bytes} [Wed Jul 27 16:40:35 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:40:35.433996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:35.434521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:35.441408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:35.442553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:35.443510 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:35.443958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:35.586900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:35.595578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-97bb4f5b-13c8-4c05-9db1-46fc177573f8 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.165549 Jul 27 16:40:35.596142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 310/594] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:35 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:36.101615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:36.102225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:36.108589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.109064 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.109827 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.110262 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.124851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:36.154528 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:36.157293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:36.163903 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.164345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.165152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.165588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.196238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7b417800-c54d-4aba-a291-6869eb4d67d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045764 Jul 27 16:40:36.196808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 311/595] 10.222.0.74 () {60 vars in 1343 bytes} [Wed Jul 27 16:40:36 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:36.257584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:36.262259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:36.262754 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:36.265762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-56dc4e30-a049-4284-a22e-5aca3c456340 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.168149 Jul 27 16:40:36.266863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 285/596] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:36 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:36.269941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.270511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.271277 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.271716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.296050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:40:36.369037 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3ec8d702-939b-42e9-817b-159241bb6dbc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 204 len: 0 microversion: 2.20 time: 0.110576 Jul 27 16:40:36.369599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 312/597] 10.222.0.74 () {60 vars in 1280 bytes} [Wed Jul 27 16:40:36 2022] DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 16:40:36.378292 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:36.378896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:36.384806 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.385293 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.386054 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.386494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.518931 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:36.526977 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:36.528489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:36.529712 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-665803e8-a591-473d-8d48-c9faa4abb948 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.155784 Jul 27 16:40:36.530250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 286/598] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:36 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:40:36.616578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:36.617316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:36.623438 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.623885 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.624650 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:36.625123 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:36.763582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:36.771488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c5798def-3daf-4511-94fd-400cfc21d515 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.159195 Jul 27 16:40:36.772047 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 313/599] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:36 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:37.011341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:37.011843 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:37.017886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.018329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.019084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.019523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.104070 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lazy-loading 'services' on Instance uuid 5e6f3001-062e-4a77-9e1d-2632c24f4c23 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:37.178542 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-681664db-5022-4ab0-a089-d93e4c0d389f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23/os-volume_attachments/fe89271d-3895-4185-ad25-4807d78fb1cc" status: 202 len: 0 microversion: 2.1 time: 0.171430 Jul 27 16:40:37.179283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 287/600] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:40:37 2022] DELETE /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23/os-volume_attachments/fe89271d-3895-4185-ad25-4807d78fb1cc => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:40:37.288195 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:37.288744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:37.295207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.295653 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.296408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.296845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.434650 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:37.442096 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ad6cb6b1-bbb8-4491-bcee-013edd9c82cc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.157843 Jul 27 16:40:37.442657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 314/601] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:37 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:37.554544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:37.555277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:37.562773 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.563344 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.564224 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.564817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.699408 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:37.708118 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:37.709701 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:37.710857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a0de31c8-d3d9-412f-b64a-977771bef2af tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.161404 Jul 27 16:40:37.711411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 288/602] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:37 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:37.792703 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:37.793553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:37.800168 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.800588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.801368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:37.801796 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:37.927336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:37.935373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-79420638-7c7d-465d-b1cd-0d31b9227a60 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1736 microversion: 2.1 time: 0.146638 Jul 27 16:40:37.935930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 315/603] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:37 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:38.468674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:38.469959 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:38.478536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:38.479296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:38.480594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:38.481359 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:38.628737 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:38.636358 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-aa2e3ea5-df2c-4c0f-b3ce-9b43690e24da tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.171860 Jul 27 16:40:38.636934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 289/604] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:38 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:38.734921 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:38.735634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:38.741840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:38.742285 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:38.743040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:38.743470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:38.886274 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:38.895449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:38.896985 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:38.898149 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8bb93a04-0565-470a-89f8-6795329413a1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.167312 Jul 27 16:40:38.898711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 316/605] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:38 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:38.956184 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:38.956816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:38.962775 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:38.963220 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:38.963985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:38.964419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.103030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:39.111505 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d1d787ba-5838-4ddf-b1e5-436c8dbcf6c4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1716 microversion: 2.1 time: 0.159661 Jul 27 16:40:39.112078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 290/606] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:38 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:39.221258 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:39.221753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:39.227735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.228182 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.228958 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.229393 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.308097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] HTTP exception thrown: Cannot 'detach_volume' instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 while it is in vm_state rescued Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Request method failure captured: Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments/295c7811-cec3-428c-ac50-dd16d4adb781 HTTP/1.1 Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wl4H6d4xrnvKRf52a3XvC7iojjzkdC5E4bq_pdSyAj-9OEEIVcu1WF2FA8RUGLlxfHE2cab0VdhGBD5aTSy_jwJ1QsAqlcK-XqWuU9SGqPXB-htrjLch8A6pE2c8LTfzHGi8fpiSZc4MBt4K164Sj57iqErVr68mXYWCPKErbz9y7w Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:40:39.309722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 1c0838069cba4d1389ec6fc809db70a7 Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:40:39.311036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Cannot 'detach_volume' instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 while it is in vm_state rescued Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'server_id': '05d821db-4106-4df9-9cec-c07b5b95e1e8', 'id': '295c7811-cec3-428c-ac50-dd16d4adb781'} Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:40:39.311747 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 while it is in vm_state rescued Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 while it is in vm_state rescued Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:39.313008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Returning 409 to user: Cannot 'detach_volume' instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 while it is in vm_state rescued {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:40:39.313954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a77ac4ac-7f78-4fcd-8a91-1d9434b4cad4 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments/295c7811-cec3-428c-ac50-dd16d4adb781" status: 409 len: 152 microversion: 2.1 time: 0.094635 Jul 27 16:40:39.313954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 317/607] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:40:39 2022] DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments/295c7811-cec3-428c-ac50-dd16d4adb781 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 16:40:39.319859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:39.320471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:39.326559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.327083 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.327921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.328456 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.392959 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-11914274-7487-4cc4-8bcf-85e8536840f3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "POST /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/action" status: 202 len: 0 microversion: 2.1 time: 0.076706 Jul 27 16:40:39.395302 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 291/608] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:40:39 2022] POST /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:40:39.401573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:39.402152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:39.404126 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:39.411436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.411826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.412629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.413109 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.546049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:39.554764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-59368e66-1880-4292-b626-45fb64c35a75 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1724 microversion: 2.1 time: 0.156932 Jul 27 16:40:39.555316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 318/609] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:39 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:39.659182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:39.659881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:39.666135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.666591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.667356 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.667796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.799093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:39.806720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1c4f44bb-7b1d-4743-be4d-e0e97731f24e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.152828 Jul 27 16:40:39.807305 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 292/610] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:39 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:39.921777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:39.923040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:39.929622 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.930104 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:39.930880 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:39.931319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:40.075872 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:40.084368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:40.085941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:40.087084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0a687ae3-70fb-44c6-94ac-db36a5a83fcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1723 microversion: 2.20 time: 0.169950 Jul 27 16:40:40.087629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 319/611] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:39 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:40.575752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:40.576518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:40.583307 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:40.583755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:40.584523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:40.585199 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:40.798694 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:40.808677 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-689d8967-25fa-4e98-bf96-ef3f29a89dad tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1724 microversion: 2.1 time: 0.236712 Jul 27 16:40:40.809668 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 293/612] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:40 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:40.828574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:40.829493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:40.835542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:40.835985 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:40.836744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:40.837196 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.037470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:41.046654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ab66141a-e609-4f22-9227-92314de13117 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.221797 Jul 27 16:40:41.048071 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 320/613] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:40 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:41.111319 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:41.111923 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:41.117838 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.118312 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.119106 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.119539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.183093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:41.192573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:41.194397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:41.195732 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c4962b58-1a5c-4f7d-9331-4d33b691c9e4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1655 microversion: 2.20 time: 0.088297 Jul 27 16:40:41.205037 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 294/614] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:41 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:40:41.241202 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-25de593d-e7ce-43ab-8a8c-6742f17ac356 req-b4930126-b2cc-4ba9-9639-72813df73e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008e56d-969e-442a-bb08-524ee7e06084", "name": "network-vif-deleted", "tag": "efc8d307-e5f0-4084-9201-4869a986c38c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:41.253039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-25de593d-e7ce-43ab-8a8c-6742f17ac356 req-b4930126-b2cc-4ba9-9639-72813df73e27 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.253484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-25de593d-e7ce-43ab-8a8c-6742f17ac356 req-b4930126-b2cc-4ba9-9639-72813df73e27 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.257947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:41.268667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-25de593d-e7ce-43ab-8a8c-6742f17ac356 req-b4930126-b2cc-4ba9-9639-72813df73e27 service nova] Creating event network-vif-deleted:efc8d307-e5f0-4084-9201-4869a986c38c for instance a008e56d-969e-442a-bb08-524ee7e06084 on hv-cinder-84969 Jul 27 16:40:41.274218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-25de593d-e7ce-43ab-8a8c-6742f17ac356 req-b4930126-b2cc-4ba9-9639-72813df73e27 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036618 Jul 27 16:40:41.275943 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 321/615] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:41.494179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:41.494680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:41.502279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.502728 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.503492 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.503922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.529064 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:40:41.605879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e1f84fea-ff97-4f4d-9e3c-6a656f679bd2 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 204 len: 0 microversion: 2.1 time: 0.115674 Jul 27 16:40:41.606463 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 295/616] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:40:41 2022] DELETE /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:40:41.616224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:41.616957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:41.623834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.624287 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.625082 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.625556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.762980 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:41.772079 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2be248a2-ff5f-4191-b512-08a346d3dbf6 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1514 microversion: 2.1 time: 0.160345 Jul 27 16:40:41.772741 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 322/617] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:41 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:41.832340 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:41.833075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:41.839055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.839508 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.840301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:41.840735 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:41.976825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:41.985495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-35991696-fbd6-4a48-aec8-a17ee0016140 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1724 microversion: 2.1 time: 0.157504 Jul 27 16:40:41.986530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 296/618] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:41 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:42.069867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:42.070460 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:42.077290 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:42.077985 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:42.078765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:42.079201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:42.221380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:42.222227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:42.222981 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:42.230215 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:42.231020 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:42.231169 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d590457c-1ade-4fb7-a7ef-86967d65178a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.165732 Jul 27 16:40:42.231700 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 323/619] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:42 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:42.231979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:42.232463 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:42.302350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:42.312214 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:42.314681 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:42.316165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fefa115d-f3e1-423b-a51b-bcb3fe0982e7 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1655 microversion: 2.20 time: 0.100541 Jul 27 16:40:42.316724 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 297/620] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:42 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:42.793228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:42.793764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:42.800283 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:42.800735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:42.801532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:42.801988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:42.944667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:42.952431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a980ebc8-cc5a-40ae-b75b-3f4fe40a729f tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1514 microversion: 2.1 time: 0.163160 Jul 27 16:40:42.953031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 324/621] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:42 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:43.006453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:43.007072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:43.014096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.014620 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.015513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.016034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.142444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:43.145140 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:43.152611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-40f8ce67-355d-46a2-8f8d-6d8fe39d41cb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1724 microversion: 2.1 time: 0.150089 Jul 27 16:40:43.153208 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 298/622] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:43 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:43.254451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:43.255258 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:43.261983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.262472 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.263243 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.263683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.341765 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:43.342632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:43.344404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:43.351183 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.351669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.352571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.353167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.388388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.388996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.389546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lazy-loading 'fault' on Instance uuid a008e56d-969e-442a-bb08-524ee7e06084 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:43.397416 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:43.404934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-479e101f-6a64-4f41-b665-74cfc66c884d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.154831 Jul 27 16:40:43.405500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 325/623] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:43 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:43.434724 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:43.443598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:43.445466 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:43.446859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c38a1870-5337-4360-bcdb-761b88d89cdd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1370 microversion: 2.20 time: 0.110223 Jul 27 16:40:43.447489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 299/624] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:43 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:40:43.976197 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:43.976820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:43.982845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.983293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:43.984050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:43.984489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.127565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:44.135414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bfd1173c-d2ed-47c8-83d0-e02240196551 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1514 microversion: 2.1 time: 0.163048 Jul 27 16:40:44.135965 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 326/625] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:43 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:44.175743 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:44.176361 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:44.182924 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.183378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.184145 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.184584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.330179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:44.338131 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8cca6f19-39e3-4774-ae6d-e4ec77554dfb tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1724 microversion: 2.1 time: 0.166798 Jul 27 16:40:44.338679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 300/626] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:44 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:44.426759 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:44.427370 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:44.433787 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.434231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.434982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.435414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.473904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:44.474639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:44.481425 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.481868 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.482747 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.483189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.516585 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:44.517065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:44.517525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lazy-loading 'fault' on Instance uuid a008e56d-969e-442a-bb08-524ee7e06084 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:44.574441 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:44.582539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:44.584063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:44.585244 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-364f0441-cd9b-4ec8-bc2d-6116d13e5c27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1370 microversion: 2.20 time: 0.116465 Jul 27 16:40:44.585799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 301/627] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:44 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:40:44.605249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:44.613241 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f608361c-d157-43c5-9c4e-c579ae8424b8 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1678 microversion: 2.1 time: 0.190862 Jul 27 16:40:44.614195 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 327/628] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:44 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:45.158529 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:45.159172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:45.165499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.165947 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.166750 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.167276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.296120 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:45.303730 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-94ed330c-def1-4eab-b27e-8ad58067c911 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1514 microversion: 2.1 time: 0.150136 Jul 27 16:40:45.304230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 302/629] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:45 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:45.359250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:45.359878 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:45.365820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.366263 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.367010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.367434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.492617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:45.500610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e2f08210-b75e-412e-a9de-0b25143c921b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1730 microversion: 2.1 time: 0.145194 Jul 27 16:40:45.501203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 328/630] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:45 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:45.521471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:45.521965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:45.527874 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.528321 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.529121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.529554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.607825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5cd9fb3f-db0f-4459-9b71-0c2705fd46ce tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089973 Jul 27 16:40:45.608354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 303/631] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:40:45 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:45.609059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:45.609729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:45.616022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.616478 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.617270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.617706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.635151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:45.635763 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:45.642742 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.643189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.644016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.644455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.650490 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:45.650940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:45.651389 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lazy-loading 'fault' on Instance uuid a008e56d-969e-442a-bb08-524ee7e06084 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:40:45.713512 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:45.722114 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:45.723621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:45.724774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-befd9791-65a6-4060-8549-998f0fc5db18 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 200 len: 1370 microversion: 2.20 time: 0.119940 Jul 27 16:40:45.725379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 329/632] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:45 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 1370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:40:46.195171 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:46.203014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fb33cb8b-e43e-415f-8905-a21c7062c3d9 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1655 microversion: 2.1 time: 0.571674 Jul 27 16:40:46.204416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 304/633] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:45 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1655 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:46.225473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e26d890c-f3be-4521-aa52-a5c79ddbc98f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:46.237893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e26d890c-f3be-4521-aa52-a5c79ddbc98f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.238838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e26d890c-f3be-4521-aa52-a5c79ddbc98f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.277330 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e26d890c-f3be-4521-aa52-a5c79ddbc98f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Going to try to start instance {{(pid=124236) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 16:40:46.296879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-ec1a1735-ae76-43e1-b708-93d9ab2644de req-9df4ecca-ccb2-4aa6-bb88-c08b0d53f94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6f3001-062e-4a77-9e1d-2632c24f4c23", "name": "network-vif-deleted", "tag": "a75b09be-0816-4dc9-9913-572323c73645"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:46.306958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ec1a1735-ae76-43e1-b708-93d9ab2644de req-9df4ecca-ccb2-4aa6-bb88-c08b0d53f94d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.307773 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ec1a1735-ae76-43e1-b708-93d9ab2644de req-9df4ecca-ccb2-4aa6-bb88-c08b0d53f94d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.323884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-ec1a1735-ae76-43e1-b708-93d9ab2644de req-9df4ecca-ccb2-4aa6-bb88-c08b0d53f94d service nova] Creating event network-vif-deleted:a75b09be-0816-4dc9-9913-572323c73645 for instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 on hv-cinder-84969 Jul 27 16:40:46.330935 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-ec1a1735-ae76-43e1-b708-93d9ab2644de req-9df4ecca-ccb2-4aa6-bb88-c08b0d53f94d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037483 Jul 27 16:40:46.332282 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 305/634] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:40:46.345459 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e26d890c-f3be-4521-aa52-a5c79ddbc98f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action" status: 202 len: 0 microversion: 2.1 time: 0.123309 Jul 27 16:40:46.350093 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 330/635] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:40:46 2022] POST /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:40:46.351943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:46.355337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:46.361204 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:46.362706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:46.366112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.366774 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.367789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.368440 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.373578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.374137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.375766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.376266 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.509092 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f17de515184c01a73c454c7f0b7e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1f193c68ef49b78c95c02f7413b7d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:46.517293 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-be2f107d-6213-43fd-97e7-5b8b07571168 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 200 len: 1304 microversion: 2.1 time: 0.183438 Jul 27 16:40:46.517857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 306/636] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:46 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:46.644994 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:46.652829 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-86292617-6293-4c1f-b7c0-c88e82fa9796 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1664 microversion: 2.1 time: 0.301321 Jul 27 16:40:46.653559 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 331/637] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:46 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1664 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:46.749682 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:46.751040 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:46.758449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.758899 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.759674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:46.760111 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:46.782134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] HTTP exception thrown: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Request method failure captured: Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 HTTP/1.1 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlxBB8KOIwfjuszefTeyvpbCGgYOniPzhWRngurJkWHCR0yyRVwknfMhYrD8j2yv7hzsHT5ovAQGGLvRi0Jfb62hV2e4oRf5KYOLy_KGuuS57lCFibhy0DmNmLWPwHWBahQWbHuH_oCsArsNvJMAUTRYQEJztP27ouDB1q6UBit9zw Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:40:46.784501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d570044769a44d9b18c905284cd9947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d570044769a44d9b18c905284cd9947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 22bb7775bae64374b11462a53853e54f Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:40:46.786077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'a008e56d-969e-442a-bb08-524ee7e06084'} Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:40:46.786848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:40:46.788065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:40:46.790943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Returning 404 to user: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:40:46.792400 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-04448dbc-9950-463e-9694-4873022efe0d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 404 len: 111 microversion: 2.20 time: 0.047159 Jul 27 16:40:46.793028 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 307/638] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:46 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:40:46.802529 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d799df1b-1f97-4984-a2d7-bf7656323bcf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '.version_select at 0x7ff56c343700>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:46.825783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d799df1b-1f97-4984-a2d7-bf7656323bcf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749446176" status: 204 len: 0 microversion: 2.20 time: 0.027377 Jul 27 16:40:46.827598 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 332/639] 10.222.0.74 () {60 vars in 1259 bytes} [Wed Jul 27 16:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749446176 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 16:40:47.233281 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-990cc382-b20f-4da6-b210-8a5996be31f7 req-a938f34f-9d84-45b9-8c22-670ac88bbebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d821db-4106-4df9-9cec-c07b5b95e1e8", "tag": "0bef1170-4e15-46fb-94c9-cabca6dd7a80"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:47.248970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-990cc382-b20f-4da6-b210-8a5996be31f7 req-a938f34f-9d84-45b9-8c22-670ac88bbebf service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:47.249419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-990cc382-b20f-4da6-b210-8a5996be31f7 req-a938f34f-9d84-45b9-8c22-670ac88bbebf service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:47.263675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-990cc382-b20f-4da6-b210-8a5996be31f7 req-a938f34f-9d84-45b9-8c22-670ac88bbebf service nova] Creating event network-changed:0bef1170-4e15-46fb-94c9-cabca6dd7a80 for instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 on hv-cinder-84969 Jul 27 16:40:47.270907 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-990cc382-b20f-4da6-b210-8a5996be31f7 req-a938f34f-9d84-45b9-8c22-670ac88bbebf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041150 Jul 27 16:40:47.271819 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 308/640] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:47.544487 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:47.545188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] [instance: 5e6f3001-062e-4a77-9e1d-2632c24f4c23] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:47.553542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:47.554760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:47.556861 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:47.557489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:47.579165 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] HTTP exception thrown: Instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 could not be found. Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Request method failure captured: Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 HTTP/1.1 Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WoJ3axjcXbL9UQUT-ff4EoxeN3FsPQUA_Jv_znrIdPgjmwu6CAotasvs8hoxQbvE8mQVqeplmZTMAMe1faHuzRpcRX9CaAIH5_fALyiHb4aA8ftwVajUJLQ-vqOiZe6YsONhKa2GzCRAfaXLrdT7k_NFlHsCDhAt9iVneUtbv-uIPU Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ce1f193c68ef49b78c95c02f7413b7d6 Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesSnapshotTestJSON-216872814 Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:40:47.581707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ce1f193c68ef49b78c95c02f7413b7d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesSnapshotTestJSON-216872814 Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ce1f193c68ef49b78c95c02f7413b7d6 Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-216872814 Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesSnapshotTestJSON-216872814-project Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 00f17de515184c01a73c454c7f0b7e70 Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesSnapshotTestJSON-216872814-project Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 could not be found. Jul 27 16:40:47.583300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '5e6f3001-062e-4a77-9e1d-2632c24f4c23'} Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 could not be found. Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:40:47.584145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 could not be found. Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 could not be found. Jul 27 16:40:47.585564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:40:47.588354 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] Returning 404 to user: Instance 5e6f3001-062e-4a77-9e1d-2632c24f4c23 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:40:47.589440 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a2b03313-e28a-4df9-95a7-939d62c49317 tempest-VolumesSnapshotTestJSON-216872814 tempest-VolumesSnapshotTestJSON-216872814-project] 10.222.0.74 "GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23" status: 404 len: 111 microversion: 2.1 time: 0.054086 Jul 27 16:40:47.590414 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 333/641] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:47 2022] GET /compute/v2.1/servers/5e6f3001-062e-4a77-9e1d-2632c24f4c23 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:40:47.676481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:47.677225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:47.684595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:47.685083 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:47.685871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:47.693671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:47.959925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-12e04d89-e972-409f-9f90-314a3edd3c9c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'create', calling method: .version_select at 0x7ff56cda10d0>, body: {"keypair": {"name": "tempest-keypair-616751187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMZYxPsRlGZaPoVLj/Mx8HsSEDTN9Q5ZRl4krDP5Rvkl2qMHPYuoTYDRwOlUswgyHGRjDPj6Glc7mDSgInBf7WWt8dGCFns1/5P5iRW4oSWNYiFgRJiOo8C9uZkt4MG9w=="}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:47.999360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-12e04d89-e972-409f-9f90-314a3edd3c9c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for project 8d570044769a44d9b18c905284cd9947. Resources: {'key_pairs'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:40:48.005242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-12e04d89-e972-409f-9f90-314a3edd3c9c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for user 22bb7775bae64374b11462a53853e54f and project 8d570044769a44d9b18c905284cd9947. Resources: {'key_pairs'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:40:48.036376 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-12e04d89-e972-409f-9f90-314a3edd3c9c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.080966 Jul 27 16:40:48.037395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 334/642] 10.222.0.74 () {62 vars in 1200 bytes} [Wed Jul 27 16:40:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 27 16:40:48.127460 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:48.136679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f16791db-e8bc-4b80-9ae5-9a89aadab780 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1664 microversion: 2.1 time: 0.465922 Jul 27 16:40:48.137302 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 309/643] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:47 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1664 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:40:49.161059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:49.162386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:49.171752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:49.173122 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:49.174266 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:49.174969 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:49.298957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-d5c39d3f-913b-4de7-9407-5b45d15f88f4 req-87b63d7f-2b2b-4549-b066-814a4d2d11c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d821db-4106-4df9-9cec-c07b5b95e1e8", "tag": "0bef1170-4e15-46fb-94c9-cabca6dd7a80"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:49.308975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-d5c39d3f-913b-4de7-9407-5b45d15f88f4 req-87b63d7f-2b2b-4549-b066-814a4d2d11c5 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:49.309421 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-d5c39d3f-913b-4de7-9407-5b45d15f88f4 req-87b63d7f-2b2b-4549-b066-814a4d2d11c5 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:49.320933 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-d5c39d3f-913b-4de7-9407-5b45d15f88f4 req-87b63d7f-2b2b-4549-b066-814a4d2d11c5 service nova] Creating event network-changed:0bef1170-4e15-46fb-94c9-cabca6dd7a80 for instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 on hv-cinder-84969 Jul 27 16:40:49.325891 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-d5c39d3f-913b-4de7-9407-5b45d15f88f4 req-87b63d7f-2b2b-4549-b066-814a4d2d11c5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031112 Jul 27 16:40:49.326484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 310/644] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:40:49.427132 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:49.434871 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-74307b1f-1fa4-4b47-81b5-d2b252a2fa0a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1668 microversion: 2.1 time: 0.279189 Jul 27 16:40:49.435430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 335/645] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:40:49 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:40:49.519101 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1014591152", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b2b545b-e176-40e2-8391-7dafbc2122d9"}], "security_groups": [{"name": "tempest-securitygroup--261258716"}], "key_name": "tempest-keypair-616751187", "user_data": "}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:49.626525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] validate_networks() for [('4b2b545b-e176-40e2-8391-7dafbc2122d9', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:40:49.983743 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:40:49.984170 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:40:49.984699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:40:49.985140 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:40:49.985559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:40:49.994352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:49.994803 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:49.995598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:49.996039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:50.012759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for project 8d570044769a44d9b18c905284cd9947. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:40:50.017282 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Getting quotas for user 22bb7775bae64374b11462a53853e54f and project 8d570044769a44d9b18c905284cd9947. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:40:50.029309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:40:50.032325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:40:50.078891 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9e6269d4-a403-4054-8c1c-7d0c53716ad5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.563855 Jul 27 16:40:50.079462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 311/646] 10.222.0.74 () {62 vars in 1188 bytes} [Wed Jul 27 16:40:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 16:40:50.090307 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-28780bdc-d477-4d6d-9564-b861917459cf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:50.090988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-28780bdc-d477-4d6d-9564-b861917459cf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:50.145702 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-28780bdc-d477-4d6d-9564-b861917459cf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:50.152921 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-28780bdc-d477-4d6d-9564-b861917459cf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:50.154434 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-28780bdc-d477-4d6d-9564-b861917459cf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:50.155535 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-28780bdc-d477-4d6d-9564-b861917459cf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1281 microversion: 2.20 time: 0.069074 Jul 27 16:40:50.156185 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 336/647] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:50 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:51.178765 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:51.179400 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:51.186553 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:51.187001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:51.188016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:51.188589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:51.250193 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:51.258093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:51.259579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:51.260654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-15dda1af-07f1-47e7-8a44-b6a6ec658f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1285 microversion: 2.20 time: 0.085871 Jul 27 16:40:51.261228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 312/648] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:51 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:52.285205 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:52.286026 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:52.293027 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:52.293478 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:52.294314 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:52.294797 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:52.455681 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:52.465663 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:52.467074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:52.468579 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-14148d56-c436-4cdf-ba8d-06d712e6ceb0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1333 microversion: 2.20 time: 0.189130 Jul 27 16:40:52.469305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 337/649] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:52 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1333 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:53.491698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:53.492967 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:53.499948 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:53.501249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:53.502208 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:53.502802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:53.788952 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:53.798901 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:53.800423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:53.802850 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-88c94a27-75d9-4b7f-b372-8bee6e4bf6b8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.315085 Jul 27 16:40:53.803405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 313/650] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:53 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:54.364712 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-37965ba2-0d1b-4385-8a60-33652d4b7768 req-1d04e137-ce42-4c4b-a259-43603542996f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:40:54.375546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-37965ba2-0d1b-4385-8a60-33652d4b7768 req-1d04e137-ce42-4c4b-a259-43603542996f service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:54.376031 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-37965ba2-0d1b-4385-8a60-33652d4b7768 req-1d04e137-ce42-4c4b-a259-43603542996f service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:54.389594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-37965ba2-0d1b-4385-8a60-33652d4b7768 req-1d04e137-ce42-4c4b-a259-43603542996f service nova] Creating event network-changed:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:40:54.394684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-37965ba2-0d1b-4385-8a60-33652d4b7768 req-1d04e137-ce42-4c4b-a259-43603542996f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035740 Jul 27 16:40:54.395573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 338/651] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:40:54.826292 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:54.826910 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:54.833478 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:54.833932 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:54.834698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:54.835138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:54.965773 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:54.973903 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:54.975415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:54.976512 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-34b1d380-20ff-4d33-8984-8a18bdfed62a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.154154 Jul 27 16:40:54.977098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 314/652] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:54 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:56.001207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:56.002176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:56.008385 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:56.008829 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:56.009616 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:56.010048 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:56.142482 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:56.150666 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:56.152254 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:56.153437 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0d5e2146-37cc-4027-88d2-8b38c6c622c2 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.157790 Jul 27 16:40:56.154061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 339/653] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:55 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:57.177280 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:57.177886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:57.184406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:57.184847 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:57.185627 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:57.186057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:57.314722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:57.322572 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:57.324083 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:57.325207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-54dbb96b-7097-4e2c-9387-d3cf688143d9 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.151797 Jul 27 16:40:57.325755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 315/654] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:57 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:58.348631 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:58.349277 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:58.356050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:58.356504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:58.357315 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:58.357753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:58.489383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:58.497235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:58.498740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:58.500326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-aef5c91d-cbff-4ec6-982e-fdc077f82c40 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.155874 Jul 27 16:40:58.500904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 340/655] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:58 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:40:59.522069 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:40:59.522675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:40:59.529178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:59.529618 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:59.530371 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:40:59.530798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:40:59.666718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:59.675006 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:59.676501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:40:59.677636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-29ab223e-3e71-4913-9d54-e5e53f008548 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.159604 Jul 27 16:40:59.678180 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 316/656] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:40:59 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:00.701836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:00.702457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:00.704942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=6 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:00.710698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:00.711146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:00.711913 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:00.712350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:00.731596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:00.850498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:00.858763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:00.860457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:00.861703 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-93dc24be-aca9-46df-a38a-69b434b04354 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.163993 Jul 27 16:41:00.862340 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 341/657] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:00 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:01.885522 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:01.886161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:01.888106 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:01.888752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:01.895393 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:01.895840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:01.896592 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:01.897047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:02.029341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:02.037323 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:02.038808 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:02.039899 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4e27926c-e3f5-4919-8914-31db35c85fce tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.158312 Jul 27 16:41:02.040444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 317/658] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:01 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:02.184916 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:02.186001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:02.192717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:02.193210 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:02.194115 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:02.194554 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:02.217991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-72697325-be14-4cef-825c-110db6eebb81 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.038795 Jul 27 16:41:02.219082 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 342/659] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:41:02 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:02.263285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-780836d6-ab8d-4e5a-a77e-4de4923d4b97 req-7d4057bc-c8da-4b5c-a6db-dae4823184fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "name": "network-vif-plugged", "status": "completed", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:02.273976 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-780836d6-ab8d-4e5a-a77e-4de4923d4b97 req-7d4057bc-c8da-4b5c-a6db-dae4823184fe service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:02.274457 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-780836d6-ab8d-4e5a-a77e-4de4923d4b97 req-7d4057bc-c8da-4b5c-a6db-dae4823184fe service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:02.287300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-780836d6-ab8d-4e5a-a77e-4de4923d4b97 req-7d4057bc-c8da-4b5c-a6db-dae4823184fe service nova] Creating event network-vif-plugged:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:41:02.293011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-780836d6-ab8d-4e5a-a77e-4de4923d4b97 req-7d4057bc-c8da-4b5c-a6db-dae4823184fe service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Jul 27 16:41:02.294360 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 318/660] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:03.117271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:03.117881 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:03.123835 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:03.124279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:03.125610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:03.126042 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:03.264039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:03.278296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:03.279814 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:03.281060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8429c99a-78e1-424f-916b-430f82259e74 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1406 microversion: 2.20 time: 0.222649 Jul 27 16:41:03.289860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 343/661] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:03 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:03.692219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69590186-cd0f-481e-80a9-09fcb76a1dfe"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:03.694720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:03.700984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:03.701463 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:03.702287 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:03.702751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:03.705375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:03.949760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-60d57727-5746-472f-83e7-745de5c6581d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262151 Jul 27 16:41:03.950350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 319/662] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:41:03 2022] POST /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:04.303565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:04.304213 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:04.310753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:04.311235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:04.312006 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:04.312444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:04.452289 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:04.460924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:04.462446 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:04.463597 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-df13dec2-92e6-47bd-a560-023dd547c3dc tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1599 microversion: 2.20 time: 0.163993 Jul 27 16:41:04.464154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 344/663] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:04 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:04.486706 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:04.487286 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:04.493639 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:04.494084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:04.494839 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:04.495270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:04.580498 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7fa78dca-a7e3-4607-b9e8-c3cac699ac90 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098379 Jul 27 16:41:04.581526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 320/664] 10.222.0.74 () {60 vars in 1316 bytes} [Wed Jul 27 16:41:04 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:41:05.518313 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-6fe410b4-f948-4ee6-8d25-1da37901b5c7 req-85961fa5-0011-44aa-b48d-9d2958b37358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:05.535016 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-6fe410b4-f948-4ee6-8d25-1da37901b5c7 req-85961fa5-0011-44aa-b48d-9d2958b37358 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:05.535663 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-6fe410b4-f948-4ee6-8d25-1da37901b5c7 req-85961fa5-0011-44aa-b48d-9d2958b37358 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:05.553068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-6fe410b4-f948-4ee6-8d25-1da37901b5c7 req-85961fa5-0011-44aa-b48d-9d2958b37358 service nova] Creating event network-changed:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:41:05.558635 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-6fe410b4-f948-4ee6-8d25-1da37901b5c7 req-85961fa5-0011-44aa-b48d-9d2958b37358 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043982 Jul 27 16:41:05.559401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 345/665] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:11.507760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69590186-cd0f-481e-80a9-09fcb76a1dfe"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:11.510141 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:11.516852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:11.517328 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:11.518096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:11.518531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:11.604693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Invalid volume: volume 69590186-cd0f-481e-80a9-09fcb76a1dfe is already attached to instances: c21a1ed6-5d26-46b1-8222-4b4fb534abb5 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: POST /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments HTTP/1.1 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 74 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:41:11.606468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {"volumeAttachment": {"volumeId": "69590186-cd0f-481e-80a9-09fcb76a1dfe"}} Jul 27 16:41:11.608057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Invalid volume: volume 69590186-cd0f-481e-80a9-09fcb76a1dfe is already attached to instances: c21a1ed6-5d26-46b1-8222-4b4fb534abb5 Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'server_id': 'c21a1ed6-5d26-46b1-8222-4b4fb534abb5', 'body': {'volumeAttachment': {'volumeId': '69590186-cd0f-481e-80a9-09fcb76a1dfe'}}} Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 69590186-cd0f-481e-80a9-09fcb76a1dfe is already attached to instances: c21a1ed6-5d26-46b1-8222-4b4fb534abb5 Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:11.609008 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 69590186-cd0f-481e-80a9-09fcb76a1dfe is already attached to instances: c21a1ed6-5d26-46b1-8222-4b4fb534abb5 Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:11.610487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 69590186-cd0f-481e-80a9-09fcb76a1dfe is already attached to instances: c21a1ed6-5d26-46b1-8222-4b4fb534abb5 Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 400 to user: Invalid volume: volume 69590186-cd0f-481e-80a9-09fcb76a1dfe is already attached to instances: c21a1ed6-5d26-46b1-8222-4b4fb534abb5 {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-00d00986-6f41-4315-ba67-6675db2131d1 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104692 Jul 27 16:41:11.611862 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 321/666] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:41:11 2022] POST /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 16:41:11.672804 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:11.673238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:11.674931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:11.680274 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:11.680713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:11.681500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:11.681925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:11.762921 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lazy-loading 'services' on Instance uuid c21a1ed6-5d26-46b1-8222-4b4fb534abb5 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:11.836162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-100bbae4-a61d-4f05-ad08-d8f53b504dfd tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments/69590186-cd0f-481e-80a9-09fcb76a1dfe" status: 202 len: 0 microversion: 2.1 time: 0.168351 Jul 27 16:41:11.836854 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 346/667] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:41:11 2022] DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments/69590186-cd0f-481e-80a9-09fcb76a1dfe => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:41:11.846314 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:11.848784 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:11.856629 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:11.857106 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:11.857951 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:11.858317 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:11.889133 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9830ba53-0f08-4f74-95c9-a02ece218a3c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Jul 27 16:41:11.889900 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 322/668] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:41:11 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:12.904025 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:12.907569 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:12.913821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:12.914262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:12.915019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:12.915450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:12.948670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7324b080-bd65-42a4-a758-752d0e9dc143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049497 Jul 27 16:41:12.954577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 347/669] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:41:12 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:41:13.023826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:13.024325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:13.031906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:13.032352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:13.033219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:13.033674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:13.060285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:41:13.173995 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dd8ccdb5-5ed4-4363-af40-51c6da700143 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 204 len: 0 microversion: 2.1 time: 0.153906 Jul 27 16:41:13.174795 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 323/670] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:41:13 2022] DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:41:13.182716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:13.183324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:13.189935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:13.190574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:13.191602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:13.192045 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:13.488778 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:13.496258 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e6349793-2cb2-4a80-827e-7646222ebfb8 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1681 microversion: 2.1 time: 0.317361 Jul 27 16:41:13.496837 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 348/671] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:13 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1681 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:14.522901 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:14.524411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:14.531022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:14.543501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:14.549275 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:14.553284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:14.553749 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:14.748525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:14.760414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3de71dd1-30e8-408c-8192-afab1577f979 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1681 microversion: 2.1 time: 0.243911 Jul 27 16:41:14.761586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 324/672] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:14 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:15.783665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:15.784208 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:15.791617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:15.792090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:15.792974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:15.793479 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:15.942332 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:15.950866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-126ede1b-0530-41a4-8f1b-44ae22702c51 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1681 microversion: 2.1 time: 0.171699 Jul 27 16:41:15.951447 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 349/673] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:15 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:16.948738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-70c30c74-b14b-43de-82d6-c8dc615c8dbe req-9d6aeb2d-42a6-439c-80bc-f3fefb446acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21a1ed6-5d26-46b1-8222-4b4fb534abb5", "name": "network-vif-deleted", "tag": "81cf0807-eaaf-44b0-aea5-82674b4921d7"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:16.960383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-70c30c74-b14b-43de-82d6-c8dc615c8dbe req-9d6aeb2d-42a6-439c-80bc-f3fefb446acf service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:16.961139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-70c30c74-b14b-43de-82d6-c8dc615c8dbe req-9d6aeb2d-42a6-439c-80bc-f3fefb446acf service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:16.975900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:16.977502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:16.982593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-70c30c74-b14b-43de-82d6-c8dc615c8dbe req-9d6aeb2d-42a6-439c-80bc-f3fefb446acf service nova] Creating event network-vif-deleted:81cf0807-eaaf-44b0-aea5-82674b4921d7 for instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 on hv-cinder-84969 Jul 27 16:41:16.988107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-70c30c74-b14b-43de-82d6-c8dc615c8dbe req-9d6aeb2d-42a6-439c-80bc-f3fefb446acf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.394621 Jul 27 16:41:16.988979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 325/674] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:16.991516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:16.992080 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:16.993671 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:16.994110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:17.034553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:17.035001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:17.035454 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lazy-loading 'fault' on Instance uuid c21a1ed6-5d26-46b1-8222-4b4fb534abb5 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:17.105127 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:17.124949 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c4bb1395-324f-446f-9b6c-181864063b2e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 200 len: 1331 microversion: 2.1 time: 0.156632 Jul 27 16:41:17.138609 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 350/675] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:16 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:18.146817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:18.148271 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:18.156999 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:18.157761 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:18.158787 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:18.161436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:18.195201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 HTTP/1.1 Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:41:18.199245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:41:18.201036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c21a1ed6-5d26-46b1-8222-4b4fb534abb5'} Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:41:18.201905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:41:18.203443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:18.205674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:41:18.206817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f82e76ec-451a-4869-bff1-580681b06c14 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 404 len: 111 microversion: 2.1 time: 0.064861 Jul 27 16:41:18.211459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 326/676] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:18 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:41:18.216321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b53e8501-fdff-4495-9588-0765f2f0521c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '.version_select at 0x7ff570cfa670>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:18.256086 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b53e8501-fdff-4495-9588-0765f2f0521c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-462249426" status: 202 len: 0 microversion: 2.1 time: 0.043454 Jul 27 16:41:18.260340 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 351/677] 10.222.0.74 () {58 vars in 1218 bytes} [Wed Jul 27 16:41:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-462249426 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:41:19.151181 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-94e941dc-4db3-4c2b-a98c-3c95cb8e7f6a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: .version_select at 0x7ff56c323dc0>, body: {"keypair": {"name": "tempest-keypair-549721005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYKR2xhRVOWiu2Gdhb5tljcrGbQ9VSIn9V5rtiwDvjGyT5cPUzizkQS9FwAeU+hhwlqT1X4+0TwHBoWJrcvUV6PZChjE0trxUioVDKcSWNgiowiF4AOt4JQLB0HpxG/Lw=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:19.179245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-94e941dc-4db3-4c2b-a98c-3c95cb8e7f6a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:41:19.184909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-94e941dc-4db3-4c2b-a98c-3c95cb8e7f6a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:41:19.218768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-94e941dc-4db3-4c2b-a98c-3c95cb8e7f6a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072008 Jul 27 16:41:19.229030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 327/678] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:41:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:21.230602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571929104", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22edebd8-fe29-44cb-9c58-64fe5ac1da5e"}], "security_groups": [{"name": "tempest-securitygroup--2078201813"}], "key_name": "tempest-keypair-549721005", "user_data": "}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:21.390875 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] validate_networks() for [('22edebd8-fe29-44cb-9c58-64fe5ac1da5e', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:41:22.097863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:41:22.098610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:41:22.099367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:41:22.100091 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:41:22.113788 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:41:22.128398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:22.129235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:22.130362 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:22.130873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:22.151947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:41:22.157140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Getting quotas for user 140059c5b30c426ab6d7f1236eb5f684 and project ebcc91e5911a4a418118b3775cfe4b76. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:41:22.174515 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:41:22.177568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:41:22.247928 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-08b7be23-d12e-4bb5-89a5-620df6103407 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.023500 Jul 27 16:41:22.248836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 352/679] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:41:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:41:22.260355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-356af187-c5b0-4aea-a6f8-a76dbdeaf25b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:22.260983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-356af187-c5b0-4aea-a6f8-a76dbdeaf25b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:22.333552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-356af187-c5b0-4aea-a6f8-a76dbdeaf25b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:22.340394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-356af187-c5b0-4aea-a6f8-a76dbdeaf25b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1241 microversion: 2.1 time: 0.084360 Jul 27 16:41:22.341286 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 328/680] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:22 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:23.361839 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:23.362450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:23.370620 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:23.371118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:23.372087 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:23.372571 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:23.456005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:23.464854 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-341cbaeb-551c-41f0-9966-ff8f8f07f416 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1293 microversion: 2.1 time: 0.106889 Jul 27 16:41:23.465612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 353/681] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:23 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:24.487935 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:24.488662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:24.495804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:24.496411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:24.497447 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:24.498295 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:24.743933 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:24.753911 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0ae9512c-9acb-4bf5-b738-09a120ef4415 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.270714 Jul 27 16:41:24.754674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 329/682] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:24 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:25.746927 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-05fee362-64b0-4f20-a12b-16e2dce55129 req-c8ff18be-86da-418a-b3c1-fdbd2638c6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55626f53-2e25-4155-8c30-c86a7f381f95", "tag": "6993eaf5-c8ad-4936-9c06-76702442c3cf"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:25.775656 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:25.776269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:25.779060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-05fee362-64b0-4f20-a12b-16e2dce55129 req-c8ff18be-86da-418a-b3c1-fdbd2638c6f0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:25.780646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-05fee362-64b0-4f20-a12b-16e2dce55129 req-c8ff18be-86da-418a-b3c1-fdbd2638c6f0 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:25.787439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:25.788210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:25.789435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:25.796772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:25.811341 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-05fee362-64b0-4f20-a12b-16e2dce55129 req-c8ff18be-86da-418a-b3c1-fdbd2638c6f0 service nova] Creating event network-changed:6993eaf5-c8ad-4936-9c06-76702442c3cf for instance 55626f53-2e25-4155-8c30-c86a7f381f95 on hv-cinder-84969 Jul 27 16:41:25.822458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-05fee362-64b0-4f20-a12b-16e2dce55129 req-c8ff18be-86da-418a-b3c1-fdbd2638c6f0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081601 Jul 27 16:41:25.823955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 354/683] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:26.064400 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:26.074795 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b5afd242-9e23-4f46-82ce-81f0d76c16ea tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.302936 Jul 27 16:41:26.075960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 330/684] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:25 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:26.496524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:26.497498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:26.504697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:26.505202 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:26.505985 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:26.506400 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:26.630972 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'services' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:26.731708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8d3ac811-9599-4111-a555-ac0f331aac4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments/295c7811-cec3-428c-ac50-dd16d4adb781" status: 202 len: 0 microversion: 2.1 time: 0.241210 Jul 27 16:41:26.732698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 355/685] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:41:26 2022] DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments/295c7811-cec3-428c-ac50-dd16d4adb781 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:41:26.741791 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:26.747353 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:26.764112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:26.764938 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:26.768022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:26.768657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:26.815512 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8145e15d-6d75-494d-939a-aa6174e7b6e9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077549 Jul 27 16:41:26.816211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 331/686] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:41:26 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:27.101886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:27.102406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:27.109520 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:27.109971 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:27.110763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:27.111203 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:27.287095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:27.301164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f2ffe396-dfca-4148-ac09-8fd9db979061 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.204201 Jul 27 16:41:27.302270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 356/687] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:27 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:27.828281 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:27.831341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:27.838409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:27.839128 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:27.840123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:27.840796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:27.872722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1dbce9b1-dd51-447e-810e-7393d919a39e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049419 Jul 27 16:41:27.873452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 332/688] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:41:27 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:28.323272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:28.324656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:28.340023 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:28.340979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:28.342647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:28.343582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:28.553034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:28.566859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5da2081d-83cb-47ff-937b-566ec027a943 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.248158 Jul 27 16:41:28.577018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 357/689] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:28 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:28.885382 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:28.887821 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:28.900722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:28.901713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:28.902746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:28.903402 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:28.943971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ae900e6f-e034-4ee9-9a79-93be7d56e71b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062626 Jul 27 16:41:28.945891 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 333/690] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:41:28 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:41:29.078382 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:29.079886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:29.090189 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.090437 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.092100 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.093550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.121403 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:41:29.167801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:29.241009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:29.244422 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:29.246465 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f2ec648c-c875-4f71-a74b-196a145c6c0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 204 len: 0 microversion: 2.1 time: 0.173937 Jul 27 16:41:29.251224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 358/691] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:41:29 2022] DELETE /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:41:29.252901 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.253540 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.254320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.254759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.257445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:29.258213 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:29.271461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.273104 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.274198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.274948 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.287065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ef0f4b52-2630-45b7-9b05-9d2b898d6c7c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051614 Jul 27 16:41:29.287621 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 334/692] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:41:29 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 16:41:29.368556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:29.369084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:29.377577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.378133 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.378982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.379424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.413334 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:41:29.443189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:29.466662 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:29.476222 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-365ccdff-093b-4796-802c-2159e3885cc3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1690 microversion: 2.1 time: 0.223598 Jul 27 16:41:29.479408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 359/693] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:29 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:29.508973 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cd80b6f1-b908-4c89-864e-112ac581f3a1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 204 len: 0 microversion: 2.1 time: 0.144162 Jul 27 16:41:29.509563 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 335/694] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:41:29 2022] DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:41:29.518221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:29.518897 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:29.525736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.526183 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.526955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.527393 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.588147 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:29.589178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:29.600762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.601332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.602729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:29.602729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:29.751827 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:29.759341 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f8e65532-e5e6-41c2-8ecf-e3273d715670 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1674 microversion: 2.1 time: 0.245201 Jul 27 16:41:29.767548 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 360/695] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:29 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1674 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:29.810609 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:29.819486 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-22c8c332-1799-4665-8e2c-b11ffdcb381c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.235500 Jul 27 16:41:29.833137 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 336/696] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:29 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:30.502230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:30.502996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:30.518269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.518855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:30.519698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.521468 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:30.574820 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-89e04cd5-9095-4067-93ef-63bd072b2fc0 req-60c99902-07cb-4604-b37c-abf0a447c64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55626f53-2e25-4155-8c30-c86a7f381f95", "name": "network-vif-plugged", "status": "completed", "tag": "6993eaf5-c8ad-4936-9c06-76702442c3cf"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:30.598065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-89e04cd5-9095-4067-93ef-63bd072b2fc0 req-60c99902-07cb-4604-b37c-abf0a447c64d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.598763 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-89e04cd5-9095-4067-93ef-63bd072b2fc0 req-60c99902-07cb-4604-b37c-abf0a447c64d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:30.617960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-89e04cd5-9095-4067-93ef-63bd072b2fc0 req-60c99902-07cb-4604-b37c-abf0a447c64d service nova] Creating event network-vif-plugged:6993eaf5-c8ad-4936-9c06-76702442c3cf for instance 55626f53-2e25-4155-8c30-c86a7f381f95 on hv-cinder-84969 Jul 27 16:41:30.625598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-89e04cd5-9095-4067-93ef-63bd072b2fc0 req-60c99902-07cb-4604-b37c-abf0a447c64d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055224 Jul 27 16:41:30.627134 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 337/697] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:41:30.682448 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:30.691656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-51a27236-83a0-47a0-8a89-cb81aee50cf7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1690 microversion: 2.1 time: 0.195486 Jul 27 16:41:30.692538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 361/698] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:30 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:30.787294 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:30.789213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:30.796667 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.797143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:30.797970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.798413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:30.840320 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:30.843722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:30.857158 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.857677 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:30.859201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:30.859728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:31.019359 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:31.027690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-480587f3-f375-429d-a1ab-6e0b19ba03eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1674 microversion: 2.1 time: 0.245203 Jul 27 16:41:31.056164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 338/699] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:30 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:31.072507 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:31.086042 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2a7866a1-ff3c-4e16-be46-0e627e568d7d tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.249622 Jul 27 16:41:31.086931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 362/700] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:30 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:31.714353 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:31.714982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:31.722612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:31.723070 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:31.723844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:31.724285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:31.873402 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:31.881669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93b4ec86-1716-4dc9-a4ff-0dd1e12fa301 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1690 microversion: 2.1 time: 0.173581 Jul 27 16:41:31.882225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 339/701] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:31 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:32.056162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:32.056753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:32.064804 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:32.065367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:32.066144 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:32.066631 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:32.115193 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:32.117979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:32.134103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:32.134647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:32.135518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:32.135952 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:32.142296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:32.169267 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=6 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:32.338509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:32.352674 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:32.362090 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e19b4814-1c04-403f-b583-47b4ed8fa276 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1674 microversion: 2.1 time: 0.310102 Jul 27 16:41:32.363310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 363/702] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:32 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:32.377024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:32.385002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2fad5652-94ab-4480-8c36-9f64f66cad07 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.273647 Jul 27 16:41:32.385846 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 340/703] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:32 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:32.903378 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:32.903990 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:32.910926 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:32.911368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:32.912135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:32.912571 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:33.060556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:33.068822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-32916a02-c0db-4a74-b6ba-7edff3c50daf tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1690 microversion: 2.1 time: 0.169230 Jul 27 16:41:33.069510 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 364/704] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:32 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:33.330000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a451f2b0-da5a-4d41-8f84-9ef79621c566 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Action: 'create', calling method: .version_select at 0x7ff56c320790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1869507167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVp1AaQ+/gDZudFR5VnSkyowesQx6/XCAYMSV0HdZnbjZKdNDww/nNqPjhA/8+klBorvY2xRl0Ex/cPkhu/B2wDAbZZSE068Ojc4aE25alPy9xkrxZBZI2LRSyM0wtBtQ=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:33.346948 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-a451f2b0-da5a-4d41-8f84-9ef79621c566 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Getting quotas for project 95d1afc492b44c07800f8d7288dac741. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:41:33.350760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-a451f2b0-da5a-4d41-8f84-9ef79621c566 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Getting quotas for user 6e5020300565412f9a251e471aeb17b9 and project 95d1afc492b44c07800f8d7288dac741. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:41:33.372199 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a451f2b0-da5a-4d41-8f84-9ef79621c566 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046630 Jul 27 16:41:33.372781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 341/705] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:41:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:33.384305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:33.385124 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:33.391893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:33.392430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:33.393298 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:33.393799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:33.405031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:33.405638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:33.411525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:33.412397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:33.413538 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:33.414122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:33.593556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:33.596650 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:33.600972 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dc474359-844a-49bd-bbb0-1900ce29adb6 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1674 microversion: 2.1 time: 0.220430 Jul 27 16:41:33.601501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 365/706] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:33 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:33.604692 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a0e68b5e-f0fb-43c4-8834-20438eb0b0fe tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.203395 Jul 27 16:41:33.605342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 342/707] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:33 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:33.605931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1190581284", "imageRef": "e590754c-2692-4885-99db-4b79ded2b2f8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1869507167", "networks": [{"uuid": "898a9478-2e06-47ac-96fa-1c8894314115"}]}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:33.658229 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] validate_networks() for [('898a9478-2e06-47ac-96fa-1c8894314115', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:41:34.020939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:41:34.021355 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:41:34.021821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:41:34.022256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:41:34.022621 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:41:34.031925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.032386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.033340 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.033811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.051037 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Getting quotas for project 95d1afc492b44c07800f8d7288dac741. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:41:34.055384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Getting quotas for user 6e5020300565412f9a251e471aeb17b9 and project 95d1afc492b44c07800f8d7288dac741. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:41:34.066617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:41:34.068777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e590754c-2692-4885-99db-4b79ded2b2f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:41:34.090570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:34.091187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:34.097934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.098386 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.099283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.099761 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.117783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3baa1aba-1019-43e0-a2c5-ff1767439c0b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515256 Jul 27 16:41:34.118529 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 366/708] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:41:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:41:34.129329 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-568512f2-9e96-4bf3-ab12-88980612116c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:34.130058 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-568512f2-9e96-4bf3-ab12-88980612116c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:34.197772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-568512f2-9e96-4bf3-ab12-88980612116c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:34.206337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-568512f2-9e96-4bf3-ab12-88980612116c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1259 microversion: 2.1 time: 0.080762 Jul 27 16:41:34.207217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 367/709] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:34 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:34.262191 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:34.270387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4c8373bd-9ebe-4225-a348-d1b84475be1f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1690 microversion: 2.1 time: 0.183563 Jul 27 16:41:34.270871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 343/710] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:34 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:34.622734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:34.623731 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:34.626970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:34.627604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:34.633201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.633791 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.635002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.636753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.637589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.638038 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:34.641891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:34.642391 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:35.027244 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:35.035945 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c52ca701-07bd-4617-9280-c9cec91e7d2e tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1674 microversion: 2.1 time: 0.417544 Jul 27 16:41:35.040998 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 368/711] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:34 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1674 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:35.044091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:35.052755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4c4e881f-f2aa-407c-a48b-5179d9217eb4 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.430781 Jul 27 16:41:35.053498 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 344/712] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:34 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:35.228263 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:35.229636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:35.236676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:35.237321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:35.238206 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:35.238861 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:35.291632 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:35.292406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:35.299237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:35.299829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:35.300831 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:35.301484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:35.366603 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:35.376095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cfa98d5b-6c0d-46fb-ad0e-21daef89902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1311 microversion: 2.1 time: 0.152237 Jul 27 16:41:35.377034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 369/713] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:35 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:35.584521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:35.598685 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9ef973a8-299a-459f-8e91-ae55df317f0c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1690 microversion: 2.1 time: 0.310877 Jul 27 16:41:35.600560 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 345/714] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:35 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1690 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:35.845678 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-8a758cef-8dd9-4083-b382-65c55216f5e5 req-6f3fefd1-295e-4669-b5b4-63b6cbd90eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d821db-4106-4df9-9cec-c07b5b95e1e8", "name": "network-vif-deleted", "tag": "0bef1170-4e15-46fb-94c9-cabca6dd7a80"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:35.855239 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-8a758cef-8dd9-4083-b382-65c55216f5e5 req-6f3fefd1-295e-4669-b5b4-63b6cbd90eb2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:35.855466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-8a758cef-8dd9-4083-b382-65c55216f5e5 req-6f3fefd1-295e-4669-b5b4-63b6cbd90eb2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:35.867826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-8a758cef-8dd9-4083-b382-65c55216f5e5 req-6f3fefd1-295e-4669-b5b4-63b6cbd90eb2 service nova] Creating event network-vif-deleted:0bef1170-4e15-46fb-94c9-cabca6dd7a80 for instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 on hv-cinder-84969 Jul 27 16:41:35.872737 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-8a758cef-8dd9-4083-b382-65c55216f5e5 req-6f3fefd1-295e-4669-b5b4-63b6cbd90eb2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Jul 27 16:41:35.873553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 370/715] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:36.057975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:36.059373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:36.076686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:36.077960 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:36.088705 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:36.089680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:36.090622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:36.091175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:36.092689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:36.094231 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:36.095030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:36.095469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:36.747304 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:36.765842 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2ad26862-ef87-464c-95a0-04326d9ef383 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1606 microversion: 2.1 time: 0.711833 Jul 27 16:41:36.766453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 346/716] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:36 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1606 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:36.978541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-da647136-4c2a-48ce-acc1-9c769839c8d1 req-42ff2657-e657-4f7f-9184-66361be83808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0065d67-39b9-4506-a9c5-e3669abc73f3", "name": "network-vif-deleted", "tag": "7d079e14-f8f7-43ce-a463-f17c326cc7bb"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:37.000202 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-da647136-4c2a-48ce-acc1-9c769839c8d1 req-42ff2657-e657-4f7f-9184-66361be83808 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.003490 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-da647136-4c2a-48ce-acc1-9c769839c8d1 req-42ff2657-e657-4f7f-9184-66361be83808 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.033244 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-da647136-4c2a-48ce-acc1-9c769839c8d1 req-42ff2657-e657-4f7f-9184-66361be83808 service nova] Creating event network-vif-deleted:7d079e14-f8f7-43ce-a463-f17c326cc7bb for instance b0065d67-39b9-4506-a9c5-e3669abc73f3 on hv-cinder-84969 Jul 27 16:41:37.041409 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:37.053013 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-da647136-4c2a-48ce-acc1-9c769839c8d1 req-42ff2657-e657-4f7f-9184-66361be83808 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278358 Jul 27 16:41:37.054044 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 347/717] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:37.060046 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-08034078-dcf7-4a55-8b94-82862ab127b7 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1367 microversion: 2.1 time: 0.989152 Jul 27 16:41:37.063143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:37.063679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 371/718] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:36 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1367 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:37.064588 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:37.086121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:37.091952 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:37.100231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.104074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.106279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.106741 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.111986 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.113181 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.114618 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.116568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.241907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.242769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.243392 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:37.257613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:37.269500 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-538bb293-fb25-4201-a016-9739cb51bb3c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1317 microversion: 2.1 time: 0.212607 Jul 27 16:41:37.270361 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 348/719] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:37 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:37.323085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:37.341988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0878aa70-098f-480d-a143-4f85755fd16c tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.277584 Jul 27 16:41:37.343182 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 372/720] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:37 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:37.790113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:37.790762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:37.802699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.803156 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.803956 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.804381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.865009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:37.865675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:37.866294 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:37.939166 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:37.954166 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b404f757-e126-46c2-9b38-079ede8a3b6c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.169052 Jul 27 16:41:37.976527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 349/721] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:37 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:38.084401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:38.086408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:38.100941 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:38.103163 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.103627 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.104404 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.105046 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.291616 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:38.292263 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:38.293596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:38.300949 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bb27345d-c017-47ba-92dc-cd6d76ba0635 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1557 microversion: 2.1 time: 0.221260 Jul 27 16:41:38.301128 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.301416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.302758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.303415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.314059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 373/722] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:38 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:38.326649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:38.327453 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:38.337779 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.338659 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.339859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.340536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.488820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-de846708-e9e7-453b-840c-c5a5f6fc62db tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169808 Jul 27 16:41:38.489453 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 374/723] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:41:38 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:38.493854 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:38.494458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:38.515012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.515557 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.516790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.522261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.549096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:38.559661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-318bed12-3fc7-46bd-adbe-1352eeb2e805 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.271186 Jul 27 16:41:38.561247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 350/724] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:38 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:38.575408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.575865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.576324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:38.620961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:38.632614 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2e088284-9276-4641-8685-1994f01d2f2e tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.142107 Jul 27 16:41:38.634462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 375/725] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:38 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:38.980314 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:38.981025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:38.987767 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.988219 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:38.989031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:38.989505 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.024111 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.024556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.025026 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:39.069209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:39.076855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c52f8341-5676-48ba-96d0-1c5979b4cefb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.101621 Jul 27 16:41:39.080948 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 351/726] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:38 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:39.578798 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-2d49f032-a0cb-4165-868b-31c850c1f3fc req-3bb3747a-fb91-49fe-85f3-6c0d1efa292e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55626f53-2e25-4155-8c30-c86a7f381f95", "tag": "6993eaf5-c8ad-4936-9c06-76702442c3cf"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:39.586058 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:39.586679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:39.590282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-2d49f032-a0cb-4165-868b-31c850c1f3fc req-3bb3747a-fb91-49fe-85f3-6c0d1efa292e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.590930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-2d49f032-a0cb-4165-868b-31c850c1f3fc req-3bb3747a-fb91-49fe-85f3-6c0d1efa292e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.594890 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.603412 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-2d49f032-a0cb-4165-868b-31c850c1f3fc req-3bb3747a-fb91-49fe-85f3-6c0d1efa292e service nova] Creating event network-changed:6993eaf5-c8ad-4936-9c06-76702442c3cf for instance 55626f53-2e25-4155-8c30-c86a7f381f95 on hv-cinder-84969 Jul 27 16:41:39.609473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-2d49f032-a0cb-4165-868b-31c850c1f3fc req-3bb3747a-fb91-49fe-85f3-6c0d1efa292e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034110 Jul 27 16:41:39.610359 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.610789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 376/727] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:39.611169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.611618 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.662063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:39.662784 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:39.672170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.672623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.673427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.673855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.699795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:39.728086 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:39.728530 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:39.729154 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:39.804417 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:39.813176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7df5c2ac-ec4e-48db-84f9-395c388463b3 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.159148 Jul 27 16:41:39.814430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 377/728] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:39 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:39.819091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:39.832758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-536b00d9-e222-47cc-9fd8-1c9dbfdc4973 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.251796 Jul 27 16:41:39.833410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 352/729] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:39 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:40.099305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:40.099918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:40.106070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.106511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.107276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.107705 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.146459 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.146900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.147338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:40.201271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:40.209399 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-990e0521-442a-415e-8641-2f68e3371699 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.113939 Jul 27 16:41:40.210010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 378/730] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:40 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:40.835562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:40.836178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:40.842927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.843638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.844415 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.844852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.847595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:40.865698 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:40.866382 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:40.879316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.879928 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.880825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.888050 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.894593 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:40.895045 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:40.895785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:40.971411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:40.981452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1bf56b5f-e8f1-4ccb-924d-a0a9f10b6712 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.149498 Jul 27 16:41:40.982381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 353/731] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:40 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:41.092650 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:41.101381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4892fbfd-bd0a-40c6-ae7c-3db6a9c38a59 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.244048 Jul 27 16:41:41.102923 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 379/732] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:40 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:41.230579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:41.231179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:41.238354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:41.238801 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:41.239569 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:41.240007 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:41.271825 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:41.272272 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:41.272712 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:41.313342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:41.321287 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-712ac1a0-640b-4ba6-9cb9-64afe7ef8a44 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.094419 Jul 27 16:41:41.330534 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 354/733] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:41 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:42.003592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:42.004286 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:42.010834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.011285 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.012160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.012589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.045652 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.046099 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.046551 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:42.099695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:42.107409 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-92769b02-adaa-4ef7-a866-0c99602fe77b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.108053 Jul 27 16:41:42.107972 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 380/734] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:41 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:42.122971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:42.123592 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:42.129925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.130383 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.131171 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.131609 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.285670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:42.293314 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1e172d9f-9f70-40e3-a145-fd763c83d6de tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.174100 Jul 27 16:41:42.293915 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 355/735] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:42 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:42.341922 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:42.342533 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:42.349239 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.349693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.350460 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.350925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.383113 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:42.383813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:42.384450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:42.429024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:42.437249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a0e826d1-55d9-4e77-bd2d-b3cf225f27cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.098659 Jul 27 16:41:42.437817 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 381/736] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:42 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:43.128950 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:43.130559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:43.133189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:43.140503 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.141048 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.141901 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.142406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.179395 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.179928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.180455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:43.227701 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:43.235349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a37e4426-0c05-4fef-88e3-c3dbae39cd4b tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.111301 Jul 27 16:41:43.235921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 356/737] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:43 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:43.317794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:43.318404 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:43.324850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.325320 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.326071 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.326499 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.458444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:43.459082 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:43.461454 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:43.472017 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.472474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.473844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:43.481738 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f8e4fe04-a236-48b0-8f87-dd9332706651 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.167695 Jul 27 16:41:43.482327 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.483010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.497224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 382/738] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:43 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:43.519657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:43.520167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:43.520619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:43.564653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:43.572154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bf197197-fae1-4b2d-8fb4-1bc5fd4942db tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.117667 Jul 27 16:41:43.572708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 357/739] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:43 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:44.256822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:44.257682 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:44.259833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:44.260774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=8 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:44.267395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.267841 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.268624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.269091 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.308911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.309366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.309812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:44.352933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:44.362644 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5e2f62b4-04b9-485b-a38a-f87f8e7f6a85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.110686 Jul 27 16:41:44.363514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 383/740] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:44 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:44.512261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:44.514228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:44.523514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.524436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.525656 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.526394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.599719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:44.600751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:44.607092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.607892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.610011 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.610704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.665769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:44.666223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:44.667018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:44.704068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:44.711813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3635a2f4-de53-42c4-94e2-10544de38762 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.206735 Jul 27 16:41:44.712468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 358/741] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:44 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:44.721881 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:44.730741 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a2319035-e619-4d02-84c6-1ae2c42adffc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.135168 Jul 27 16:41:44.731556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 384/742] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:44 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:45.384824 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:45.385468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:45.391489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.391941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.392710 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.393169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.426657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.427021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.427485 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 05d821db-4106-4df9-9cec-c07b5b95e1e8 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:45.468970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:45.476301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f888a257-5bd1-47a4-9d14-9be0d4c638ee tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 200 len: 1335 microversion: 2.1 time: 0.095614 Jul 27 16:41:45.476846 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 359/743] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:45 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:45.733498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:45.734125 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:45.740751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.741465 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.742253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.742687 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.751607 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:45.752223 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:45.759548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.760062 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.762068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.762068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.796459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:45.797076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:45.797535 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid b0065d67-39b9-4506-a9c5-e3669abc73f3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:45.871483 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:45.879179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-add01d29-701e-4b83-a7c6-1e112d2ba2c3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 200 len: 1327 microversion: 2.1 time: 0.131421 Jul 27 16:41:45.880191 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 360/744] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:45 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:46.072784 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:46.081020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-acac9f08-eca7-4359-88b5-d4844d9b3800 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.351336 Jul 27 16:41:46.081591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 385/745] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:45 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:46.498131 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:46.499027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 05d821db-4106-4df9-9cec-c07b5b95e1e8] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:46.506293 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:46.506744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:46.507515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:46.507958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:46.521381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] HTTP exception thrown: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 could not be found. Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Request method failure captured: Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 HTTP/1.1 Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl4H6d4xrnvKRf52a3XvC7iojjzkdC5E4bq_pdSyAj-9OEEIVcu1WF2FA8RUGLlxfHE2cab0VdhGBD5aTSy_jwJ1QsAqlcK-XqWuU9SGqPXB-htrjLch8A6pE2c8LTfzHGi8fpiSZc4MBt4K164Sj57iqErVr68mXYWCPKErbz9y7w Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:41:46.523159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 1c0838069cba4d1389ec6fc809db70a7 Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 could not be found. Jul 27 16:41:46.524738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '05d821db-4106-4df9-9cec-c07b5b95e1e8'} Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 could not be found. Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:41:46.525617 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 could not be found. Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 could not be found. Jul 27 16:41:46.527000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.528128 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Returning 404 to user: Instance 05d821db-4106-4df9-9cec-c07b5b95e1e8 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:41:46.528128 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5dfa46e1-51f4-4957-9931-e0c337910d8f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8" status: 404 len: 111 microversion: 2.1 time: 0.031082 Jul 27 16:41:46.528128 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 361/746] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:46 2022] GET /compute/v2.1/servers/05d821db-4106-4df9-9cec-c07b5b95e1e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:41:46.533809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fbf18fce-6d01-4db9-9ca4-9c6ffad83d76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '.version_select at 0x7ff570c63940>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:46.553070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fbf18fce-6d01-4db9-9ca4-9c6ffad83d76 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963661506" status: 202 len: 0 microversion: 2.1 time: 0.023098 Jul 27 16:41:46.553676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 386/747] 10.222.0.74 () {58 vars in 1218 bytes} [Wed Jul 27 16:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963661506 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:41:46.755721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-e38faaaa-2959-442f-87e7-fa28df3db869 req-2a7916a9-081c-4acf-a425-c968993aba11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:46.775816 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e38faaaa-2959-442f-87e7-fa28df3db869 req-2a7916a9-081c-4acf-a425-c968993aba11 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:46.776552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-e38faaaa-2959-442f-87e7-fa28df3db869 req-2a7916a9-081c-4acf-a425-c968993aba11 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:46.799901 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-e38faaaa-2959-442f-87e7-fa28df3db869 req-2a7916a9-081c-4acf-a425-c968993aba11 service nova] Creating event network-changed:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:41:46.807065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-e38faaaa-2959-442f-87e7-fa28df3db869 req-2a7916a9-081c-4acf-a425-c968993aba11 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064520 Jul 27 16:41:46.807966 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 362/748] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:46.904377 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:46.906422 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:46.913038 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:46.913864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:46.914725 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:46.915271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:46.932358 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] HTTP exception thrown: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Request method failure captured: Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 HTTP/1.1 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wl0PGRD37_-f9N5aZjKDNa6bxObvG2n6FpXKwzX_uto8dtaAksJjEc1-ixKBPChc215xKX1ZvysWsiA2G8rcScZO3MivynuBU4Ec5CKlNnZcPvOFk6L_QM68E_DRo61PJvJxuV_G1datS-5FkFg0Xq57-7zBYL00HZkaykgp5FzS74 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:41:46.934360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 7a0bd78165c94d9e9750fe4af4f7d375 Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:41:46.935939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'b0065d67-39b9-4506-a9c5-e3669abc73f3'} Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:41:46.936982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:41:46.938420 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:41:46.940779 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Returning 404 to user: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:41:46.941869 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-84c08d71-1897-4c2f-93f4-56b11f53c656 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 404 len: 111 microversion: 2.1 time: 0.041895 Jul 27 16:41:46.951785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-57e7174d-0e10-47f6-a32d-07f65eef6382 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '.version_select at 0x7ff56c320040>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:46.956989 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 387/749] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:46 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:41:46.976873 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-57e7174d-0e10-47f6-a32d-07f65eef6382 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364840970" status: 202 len: 0 microversion: 2.1 time: 0.029292 Jul 27 16:41:46.977563 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 363/750] 10.222.0.74 () {58 vars in 1221 bytes} [Wed Jul 27 16:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364840970 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:41:47.102543 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:47.103458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:47.111731 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:47.112263 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:47.113163 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:47.113704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:47.362775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:47.373675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b718cc19-522b-45b2-9aa5-e4d2018a10c0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.274944 Jul 27 16:41:47.374500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 388/751] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:47 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:47.800652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6578efa4-433c-478b-8ba4-5bbdc5a11325 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: .version_select at 0x7ff56c336790>, body: {"keypair": {"name": "tempest-keypair-52880838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9p3/GZq87dh5DdFzrso5GDorsJBa3AlAtPCstVeU3u59vnedBPF/2jdPYRxlDxxJ5DfcHBP0XEnpXrGr5vWz5OCf2z6JqgpLpzF1jBZ0sr4GTvPdmCMWCgPIJbvnNb0g=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:47.816915 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6578efa4-433c-478b-8ba4-5bbdc5a11325 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for project 89ddf8711f2f4be88304f967149c3a50. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:41:47.820690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6578efa4-433c-478b-8ba4-5bbdc5a11325 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for user 7a0bd78165c94d9e9750fe4af4f7d375 and project 89ddf8711f2f4be88304f967149c3a50. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:41:47.841411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6578efa4-433c-478b-8ba4-5bbdc5a11325 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045400 Jul 27 16:41:47.841990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 364/752] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:41:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:48.397978 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:48.398591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:48.407840 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:48.408542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:48.409518 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:48.410106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:48.614349 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:48.632871 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9f8e5ed0-a007-48a2-8013-a5bfd4b5f83d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.238515 Jul 27 16:41:48.646068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 389/753] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:48 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:48.924990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:48.925874 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:48.933083 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:48.933694 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:48.934594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:48.935165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:48.959838 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f8da9050-661c-4026-8335-ed8ee3fe57f4 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/ips" status: 200 len: 152 microversion: 2.20 time: 0.039944 Jul 27 16:41:48.960589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 365/754] 10.222.0.74 () {60 vars in 1289 bytes} [Wed Jul 27 16:41:48 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:41:49.191930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-237493318", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f30e4e1-bf07-478c-895f-f27f24b25617"}], "security_groups": [{"name": "tempest-securitygroup--993645515"}], "key_name": "tempest-keypair-52880838", "user_data": "}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:49.309257 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.network.neutron [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] validate_networks() for [('5f30e4e1-bf07-478c-895f-f27f24b25617', None, None, None, None, None)] {{(pid=124236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:41:49.656354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:49.657244 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:49.663876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:49.664359 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:49.665385 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:49.665902 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:49.960375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:49.967898 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7bd13f6f-5372-465a-9b0e-7b99708f367b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.316041 Jul 27 16:41:49.968811 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 366/755] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:49 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:49.973465 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:49.974123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:49.979777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:49.980230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:49.981023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:49.981467 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.003771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Flavor limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:41:50.004262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Image limits 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:41:50.004648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Flavor pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:41:50.005083 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Image pref 0:0:0 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:41:50.005491 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.virt.hardware [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:41:50.006778 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:41:50.015628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.016199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.017106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.017549 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.034506 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for project 89ddf8711f2f4be88304f967149c3a50. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:41:50.038466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Getting quotas for user 7a0bd78165c94d9e9750fe4af4f7d375 and project 89ddf8711f2f4be88304f967149c3a50. Resources: {'instances', 'ram', 'cores'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:41:50.049846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Going to run 1 instances... {{(pid=124236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:41:50.052127 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:41:50.085468 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-301f2354-bbe4-4104-a87f-e0bd5f4a2ee0 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "DELETE /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 204 len: 0 microversion: 2.1 time: 0.115295 Jul 27 16:41:50.086357 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 367/756] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:41:49 2022] DELETE /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:41:50.095499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:50.096218 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:50.102180 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.102633 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.103403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.103669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d9e8feab-da54-4934-ba6d-e6fd1f26413d tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.915929 Jul 27 16:41:50.103838 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.104649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 390/757] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:41:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:41:50.115773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4fa8a8ca-b5e8-4f64-af33-761a6079ca24 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:50.116516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4fa8a8ca-b5e8-4f64-af33-761a6079ca24 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:50.178046 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-4fa8a8ca-b5e8-4f64-af33-761a6079ca24 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:50.187381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4fa8a8ca-b5e8-4f64-af33-761a6079ca24 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1235 microversion: 2.1 time: 0.074798 Jul 27 16:41:50.187939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 391/758] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:50 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:50.277151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:50.284877 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9edf12de-b51f-48ea-b8b0-fbd63d2ffc7a tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1507 microversion: 2.1 time: 0.194130 Jul 27 16:41:50.285566 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 368/759] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:50 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:50.629839 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-f2380378-0072-479e-98ed-0c04c195880f req-c8364e3a-85a2-4c2c-a1a9-2037de5a2bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "name": "network-vif-plugged", "status": "completed", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:50.639261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f2380378-0072-479e-98ed-0c04c195880f req-c8364e3a-85a2-4c2c-a1a9-2037de5a2bcd service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.640341 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f2380378-0072-479e-98ed-0c04c195880f req-c8364e3a-85a2-4c2c-a1a9-2037de5a2bcd service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.650812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-f2380378-0072-479e-98ed-0c04c195880f req-c8364e3a-85a2-4c2c-a1a9-2037de5a2bcd service nova] Creating event network-vif-plugged:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:41:50.655562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-f2380378-0072-479e-98ed-0c04c195880f req-c8364e3a-85a2-4c2c-a1a9-2037de5a2bcd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088820 Jul 27 16:41:50.656119 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 392/760] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:50.989099 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:50.989734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:50.996183 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.996620 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:50.997399 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:50.997826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.129076 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:51.131388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:51.138114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8a57663d-2db5-468b-bf05-7da18f35961e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.152835 Jul 27 16:41:51.138663 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 369/761] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:50 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:51.208147 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:51.208844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:51.215069 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.215516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.216274 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.216720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.275885 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:51.276435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:51.284193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:51.287291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.287855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.288743 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.289330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.293746 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f75acc01-ad21-4dd0-8e65-2a8b1489826c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1239 microversion: 2.1 time: 0.089711 Jul 27 16:41:51.294594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 393/762] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:51 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:51.305843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:51.306652 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:51.312492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.312964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.313720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.314145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.318336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lazy-loading 'flavor' on Instance uuid dac1640a-1831-422b-b041-ca09c22cfec3 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:51.449710 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:51.459256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bddfd6b4-b331-499a-b595-e8019b91f8a1 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1507 microversion: 2.1 time: 0.157042 Jul 27 16:41:51.459861 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 394/763] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:51 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:51.500785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e165010b-ed68-4f95-83e7-0bdbb0e4fb07 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/action" status: 202 len: 0 microversion: 2.20 time: 0.228965 Jul 27 16:41:51.501689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 370/764] 10.222.0.74 () {62 vars in 1319 bytes} [Wed Jul 27 16:41:51 2022] POST /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:41:51.509673 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:51.510290 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:51.517736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.518185 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.518952 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:51.519387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:51.659313 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:51.667248 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:51.668964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:51.670131 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ac5ae624-0adf-400f-bd67-7f8d013c9c6d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.164331 Jul 27 16:41:51.671219 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 395/765] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:51 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:52.158855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:52.159665 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:52.167062 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.168179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.169082 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.169724 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.316416 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:52.317064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:52.323084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.323533 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.324293 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.324734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.329494 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:52.408232 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:52.411368 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:52.418859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-186512f8-5e3f-434c-a45f-e2847ff798bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.264665 Jul 27 16:41:52.419640 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 371/766] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:52 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:52.422326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3f010268-ac58-4507-99dc-aa3d4cf2271c tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1287 microversion: 2.1 time: 0.109684 Jul 27 16:41:52.423017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 396/767] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:52 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:52.480979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:52.481571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:52.488063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.488494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.489354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.489836 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.565283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:52.573864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e4aa1cec-b8b9-45c7-aa03-4723308b220d tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1465 microversion: 2.1 time: 0.096863 Jul 27 16:41:52.575182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 372/768] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:52 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:52.649942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-f8df960f-f1b3-4fd1-b498-e229ee2259e7 req-c01e6843-1b8d-4b5b-b9d3-6fe05836648e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdc21ff-3230-4793-bfe7-b12d4ea18cf2", "name": "network-vif-deleted", "tag": "9368fc6a-10b9-4455-a76f-7ab085d78bdc"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:52.659805 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f8df960f-f1b3-4fd1-b498-e229ee2259e7 req-c01e6843-1b8d-4b5b-b9d3-6fe05836648e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.660331 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f8df960f-f1b3-4fd1-b498-e229ee2259e7 req-c01e6843-1b8d-4b5b-b9d3-6fe05836648e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.672015 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-f8df960f-f1b3-4fd1-b498-e229ee2259e7 req-c01e6843-1b8d-4b5b-b9d3-6fe05836648e service nova] Creating event network-vif-deleted:9368fc6a-10b9-4455-a76f-7ab085d78bdc for instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 on hv-cinder-84969 Jul 27 16:41:52.676674 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-f8df960f-f1b3-4fd1-b498-e229ee2259e7 req-c01e6843-1b8d-4b5b-b9d3-6fe05836648e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030413 Jul 27 16:41:52.677375 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 397/769] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:52.693738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:52.694360 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:52.700504 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.701016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.701817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:52.702316 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:52.830723 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:52.838671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:52.840176 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:52.841363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-729ea0d0-bec7-436b-96b5-3ab0ee572daf tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.151552 Jul 27 16:41:52.841906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 373/770] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:52 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:53.440750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:53.441373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:53.442612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:53.443225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:53.447868 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.448334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.449143 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.449582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.455119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.455609 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.456419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.457058 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.571679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:53.581414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-54cf3fb7-ab9e-44b5-9742-d2f32f0e9acb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1293 microversion: 2.1 time: 0.142515 Jul 27 16:41:53.589091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 374/771] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:53 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:53.594212 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:53.595000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:53.603905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.604595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.605608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.606758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.650220 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.650665 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.651108 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:53.654387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:53.662505 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5e50d712-355f-45a1-9ce2-6dc59e6e3b6f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1359 microversion: 2.1 time: 0.226039 Jul 27 16:41:53.663075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 398/772] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:53 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:53.733389 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:53.740625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a9464f1c-0ec9-45f7-8974-cd45613b75b9 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 200 len: 1311 microversion: 2.1 time: 0.150323 Jul 27 16:41:53.741214 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 375/773] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:53 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:53.865889 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:53.866909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:53.873291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.873742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:53.874645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:53.875080 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.086724 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:54.099135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:54.101737 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:54.103566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8e2626cd-d7f7-4087-a50e-a9a154dcca32 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.242019 Jul 27 16:41:54.106229 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 399/774] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:53 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:54.607648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:54.608711 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:54.615194 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.615640 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.616401 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.616833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.683021 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:54.683768 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:54.691026 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.691547 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.692431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.692970 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.880030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:54.895899 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a9a943a2-0722-4edd-a1ae-f64f3c0547fb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.291920 Jul 27 16:41:54.897016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 376/775] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:54 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:54.910721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:54.911430 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:54.917751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.918530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.919473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.920073 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.935689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] HTTP exception thrown: Instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 could not be found. Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Request method failure captured: Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 HTTP/1.1 Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl4H6d4xrnvKRf52a3XvC7iojjzkdC5E4bq_pdSyAj-9OEEIVcu1WF2FA8RUGLlxfHE2cab0VdhGBD5aTSy_jwJ1QsAqlcK-XqWuU9SGqPXB-htrjLch8A6pE2c8LTfzHGi8fpiSZc4MBt4K164Sj57iqErVr68mXYWCPKErbz9y7w Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:41:54.938164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 1c0838069cba4d1389ec6fc809db70a7 Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 could not be found. Jul 27 16:41:54.939746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '2bdc21ff-3230-4793-bfe7-b12d4ea18cf2'} Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 could not be found. Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:41:54.940604 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 could not be found. Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 could not be found. Jul 27 16:41:54.945654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:41:54.947739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Returning 404 to user: Instance 2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:41:54.947739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-216a819f-eee7-4a9f-95b8-e76b5b557e0f tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2" status: 404 len: 111 microversion: 2.1 time: 0.043359 Jul 27 16:41:54.947739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 377/776] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:54 2022] GET /compute/v2.1/servers/2bdc21ff-3230-4793-bfe7-b12d4ea18cf2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:41:54.952526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:54.953283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:54.959977 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.960679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.961690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:54.962313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:54.990136 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:54.992172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:41:55.001238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2918e0b0-c02a-40c0-9280-536b85b61ab2 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1548 microversion: 2.1 time: 0.322088 Jul 27 16:41:55.003198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 400/777] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:54 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1548 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:55.026717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:55.028284 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:55.035784 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.036485 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.037842 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.038445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.091708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3ac78e86-6362-4a5d-a0da-cd14791843f5 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "DELETE /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 204 len: 0 microversion: 2.1 time: 0.143358 Jul 27 16:41:55.092363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 378/778] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:41:54 2022] DELETE /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:41:55.102002 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:55.103085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:55.109658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.114928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.117208 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.118015 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.353128 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.368669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c029e7f9-66b7-4f75-b1fe-ff104b0e66e5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1548 microversion: 2.1 time: 0.348428 Jul 27 16:41:55.384272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 401/779] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:55 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1548 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:55.384272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:55.384272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:55.384272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.384933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.385031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.385156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.385156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.393127 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1eff3a29-4d95-4b17-8c88-28100d7432b6 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.295498 Jul 27 16:41:55.393961 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 379/780] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:55 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:41:55.398551 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-01ce69ef-806a-4c3d-8573-d6033ea90112 req-358b3391-2b3a-445b-a306-afe9d11e5059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135ef04d-6996-46ef-90a6-39ad9504292b", "tag": "f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:55.408782 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-01ce69ef-806a-4c3d-8573-d6033ea90112 req-358b3391-2b3a-445b-a306-afe9d11e5059 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.409330 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-01ce69ef-806a-4c3d-8573-d6033ea90112 req-358b3391-2b3a-445b-a306-afe9d11e5059 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.420786 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-01ce69ef-806a-4c3d-8573-d6033ea90112 req-358b3391-2b3a-445b-a306-afe9d11e5059 service nova] Creating event network-changed:f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c for instance 135ef04d-6996-46ef-90a6-39ad9504292b on hv-cinder-84969 Jul 27 16:41:55.425994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-01ce69ef-806a-4c3d-8573-d6033ea90112 req-358b3391-2b3a-445b-a306-afe9d11e5059 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030686 Jul 27 16:41:55.426758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 380/781] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:55.432130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:55.438448 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.439220 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Searching by: {'deleted': False, 'project_id': '95d1afc492b44c07800f8d7288dac741'} {{(pid=124235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 27 16:41:55.446573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.447366 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.448166 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.448599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.520876 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.532556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.534098 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.536610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a86f558a-d943-4670-b35e-5920db5e1953 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.164712 Jul 27 16:41:55.537214 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 402/782] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:55 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:55.542475 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.multi_cell_list [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 16:41:55.634922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f81d3398-18fc-4ff7-a3a9-736189b978a5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206776 Jul 27 16:41:55.635580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 381/783] 10.222.0.74 () {58 vars in 1125 bytes} [Wed Jul 27 16:41:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:55.647261 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:55.647808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:55.653769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.654212 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.654993 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.656028 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.780752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:55.788216 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b957894e-6fd8-4806-8a4d-c55b2685500c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1548 microversion: 2.1 time: 0.144784 Jul 27 16:41:55.788776 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 403/784] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:55 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:55.916932 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:55.917688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:55.924323 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.924913 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:55.925818 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:55.926283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:56.066985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:56.076978 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-171f324e-eff4-4f01-a624-bde3309ed4b5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.163818 Jul 27 16:41:56.085357 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 382/785] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:55 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:56.414972 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:56.415585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:56.421607 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:56.421994 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:56.422750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:56.423181 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:56.548188 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:56.555507 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1b0077e5-091f-4c42-8a57-bc831b5db4f7 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.144398 Jul 27 16:41:56.556093 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 404/786] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:56 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:56.559409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:56.560018 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:56.575667 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:56.576117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:56.576920 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:56.577370 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:56.594347 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:56.721521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:56.729417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:56.730963 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:56.732136 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b51018a1-cd33-4cb4-aa33-e819d05777c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.176563 Jul 27 16:41:56.732692 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 383/787] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:56 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:41:57.098879 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:57.099408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:57.105864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.106311 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.107076 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.107517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.270460 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:57.278276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e0ceb200-70cf-43b4-87ae-45b5aa2123d3 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.183176 Jul 27 16:41:57.278956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 405/788] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:57 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:57.333661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6ea1f15-4943-4c2d-9c1e-2070202241a1"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:57.335936 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:57.341777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.342221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.343499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.344182 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.576641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:57.577947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:57.580182 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:57.585713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.586162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.586994 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.587429 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.751986 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-815f7879-4060-45a5-a717-5e81d0e5a428 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421939 Jul 27 16:41:57.758394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 384/789] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:41:57 2022] POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:41:57.759547 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:57.759770 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:57.767793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.768448 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.769301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:57.769810 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:57.827762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:57.985893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:57.993662 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-50a6ca70-9b0b-4637-a27e-abb655dc9233 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1520 microversion: 2.1 time: 0.420902 Jul 27 16:41:57.994270 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 406/790] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:57 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:58.119382 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:58.127793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:58.129344 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:58.130594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a0609cee-3ce9-4524-82aa-776bbb2fc08b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.376667 Jul 27 16:41:58.131138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 385/791] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:57 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:58.299910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:58.301608 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:58.308256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:58.308710 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:58.309516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:58.309962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:58.711975 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1b37c547-50eb-4631-aa37-0e9346899640 req-596114ab-ecbd-47b6-8b94-10e2b5a8366f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c4add4-825e-428a-b0ba-a2f6447d80a7", "name": "network-vif-deleted", "tag": "ee2f2c0f-c666-48ff-8555-4ac295050a28"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:41:58.749829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1b37c547-50eb-4631-aa37-0e9346899640 req-596114ab-ecbd-47b6-8b94-10e2b5a8366f service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:58.754923 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1b37c547-50eb-4631-aa37-0e9346899640 req-596114ab-ecbd-47b6-8b94-10e2b5a8366f service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:58.759606 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:58.770230 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b918656e-6f65-4473-af34-3fb63617ecef tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.475140 Jul 27 16:41:58.775419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 407/792] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:58 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:58.781132 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1b37c547-50eb-4631-aa37-0e9346899640 req-596114ab-ecbd-47b6-8b94-10e2b5a8366f service nova] Creating event network-vif-deleted:ee2f2c0f-c666-48ff-8555-4ac295050a28 for instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 on hv-cinder-84969 Jul 27 16:41:58.788090 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1b37c547-50eb-4631-aa37-0e9346899640 req-596114ab-ecbd-47b6-8b94-10e2b5a8366f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083238 Jul 27 16:41:58.788823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 386/793] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:41:59.016947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:59.017613 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:59.023904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.024358 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.025155 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.025595 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.057572 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.058023 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.058472 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lazy-loading 'fault' on Instance uuid 71c4add4-825e-428a-b0ba-a2f6447d80a7 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:41:59.100757 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0838069cba4d1389ec6fc809db70a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027a003da80c43ca9b4b337527b93d3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:59.108778 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ec092b18-c5dc-4ec8-91aa-b6e12136aa85 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 200 len: 1311 microversion: 2.1 time: 0.097106 Jul 27 16:41:59.109357 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 408/794] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:59 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:41:59.155189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:59.155886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:59.162168 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.162609 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.163376 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.163812 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.294989 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:59.303373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:59.304880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:59.306089 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ec35fdbf-78aa-4df8-a810-4b693d21e4b1 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.155169 Jul 27 16:41:59.306630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 387/795] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:41:59 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:41:59.791566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:41:59.792174 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:41:59.798577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.799025 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.799780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:41:59.800211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:41:59.927617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:41:59.935419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-87104f5e-0039-4ceb-88fa-676835aa0018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.147742 Jul 27 16:41:59.935977 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 409/796] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:41:59 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:00.133909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:00.134982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] [instance: 71c4add4-825e-428a-b0ba-a2f6447d80a7] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:00.144342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:00.144790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:00.146363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:00.146890 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:00.161901 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] HTTP exception thrown: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 could not be found. Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Request method failure captured: Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 HTTP/1.1 Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl4H6d4xrnvKRf52a3XvC7iojjzkdC5E4bq_pdSyAj-9OEEIVcu1WF2FA8RUGLlxfHE2cab0VdhGBD5aTSy_jwJ1QsAqlcK-XqWuU9SGqPXB-htrjLch8A6pE2c8LTfzHGi8fpiSZc4MBt4K164Sj57iqErVr68mXYWCPKErbz9y7w Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:42:00.163567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/027a003da80c43ca9b4b337527b93d3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 027a003da80c43ca9b4b337527b93d3a Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-439796138 Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 1c0838069cba4d1389ec6fc809db70a7 Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-439796138-project Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 could not be found. Jul 27 16:42:00.165186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '71c4add4-825e-428a-b0ba-a2f6447d80a7'} Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 could not be found. Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:00.165994 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 could not be found. Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 could not be found. Jul 27 16:42:00.167125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:00.168169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] Returning 404 to user: Instance 71c4add4-825e-428a-b0ba-a2f6447d80a7 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:00.168169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-48069ca5-54f2-45f9-82f8-25c6bc900459 tempest-ServerRescueNegativeTestJSON-439796138 tempest-ServerRescueNegativeTestJSON-439796138-project] 10.222.0.74 "GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7" status: 404 len: 111 microversion: 2.1 time: 0.038931 Jul 27 16:42:00.168169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 388/797] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:00 2022] GET /compute/v2.1/servers/71c4add4-825e-428a-b0ba-a2f6447d80a7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:00.330135 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:00.330773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:00.332604 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:00.333317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=8 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:00.339436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:00.340009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:00.340765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:00.341220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:00.485634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:00.497252 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:00.498778 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:00.499931 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6690e134-1248-4a4e-aa3d-35389ced9c6b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.174321 Jul 27 16:42:00.500483 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 410/798] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:00 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:00.956834 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:00.957770 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:00.960375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:00.968127 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:00.969310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:00.970404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:00.970919 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:01.130674 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:01.138813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f11e7a86-8a87-4c63-887b-d21e5e502eda tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.187045 Jul 27 16:42:01.141855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 389/799] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:00 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:01.523511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:01.524220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:01.531443 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:01.531892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:01.532661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:01.533129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:01.664432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:01.673040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:01.674549 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:01.675759 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-62178040-2188-4f4d-8c2a-1586bf0dc05b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.156454 Jul 27 16:42:01.676313 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 411/800] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:01 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:02.159472 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:02.160516 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:02.173101 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:02.173635 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:02.174497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:02.175003 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:02.329123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:02.336793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d43c8984-8ab8-480d-bfda-48dfcad55644 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.181202 Jul 27 16:42:02.337373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 390/801] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:02 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:02.631049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-8875fbbf-a9bf-4cec-9c6f-4355ad65a8dd req-d1651206-7a2a-4f13-8ac8-a20c1ec39f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135ef04d-6996-46ef-90a6-39ad9504292b", "name": "network-vif-plugged", "status": "completed", "tag": "f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:02.643243 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-8875fbbf-a9bf-4cec-9c6f-4355ad65a8dd req-d1651206-7a2a-4f13-8ac8-a20c1ec39f9b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:02.643934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-8875fbbf-a9bf-4cec-9c6f-4355ad65a8dd req-d1651206-7a2a-4f13-8ac8-a20c1ec39f9b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:02.660025 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-8875fbbf-a9bf-4cec-9c6f-4355ad65a8dd req-d1651206-7a2a-4f13-8ac8-a20c1ec39f9b service nova] Creating event network-vif-plugged:f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c for instance 135ef04d-6996-46ef-90a6-39ad9504292b on hv-cinder-84969 Jul 27 16:42:02.665449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-8875fbbf-a9bf-4cec-9c6f-4355ad65a8dd req-d1651206-7a2a-4f13-8ac8-a20c1ec39f9b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039107 Jul 27 16:42:02.666235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 412/802] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:02.699568 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:02.700418 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:02.707306 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:02.707752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:02.708525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:02.708981 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:03.030579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:03.038423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:03.039955 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:03.041178 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-582c8430-94ea-443d-aedb-a7da0db55f8a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.345748 Jul 27 16:42:03.041721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 391/803] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:02 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:03.359532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:03.360624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:03.369295 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:03.370171 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:03.370962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:03.371955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:03.621221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:03.624753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:03.629550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b01df6e4-7771-4af1-933d-aaf225700018 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.275268 Jul 27 16:42:03.630419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 413/804] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:03 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:42:04.065023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:04.066177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:04.073867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:04.074329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:04.075269 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:04.075598 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:04.215307 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:04.227350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:04.229203 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:04.230494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e13540d1-00ca-45d4-a127-d34d62098a29 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.170899 Jul 27 16:42:04.231038 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 392/805] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:04 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:04.650806 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:04.651674 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:04.658910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:04.659363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:04.660141 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:04.660581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:04.818763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:04.826217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-81690461-c8e7-4158-b366-6242a065fa22 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1360 microversion: 2.1 time: 0.179443 Jul 27 16:42:04.826804 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 414/806] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:04 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:05.256103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:05.256716 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:05.270889 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:05.271679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:05.272675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:05.273558 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:05.418869 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:05.427379 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:05.429203 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:05.430983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-592bd4b7-0aa2-44d2-a849-5546b8930131 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.180663 Jul 27 16:42:05.431532 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 393/807] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:05 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:05.847059 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:05.847935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:05.854336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:05.854785 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:05.855785 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:05.856067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.021173 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:06.029850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-547168ed-50e0-4aa6-a93f-2cc4f8bc40ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1545 microversion: 2.1 time: 0.186820 Jul 27 16:42:06.031363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 415/808] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:05 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1545 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:06.051884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:06.052434 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:06.054296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:06.059737 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:06.060186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.061034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:06.061458 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.177673 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-08411161-77c5-47e6-b448-4be16e8325eb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129679 Jul 27 16:42:06.178261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 394/809] 10.222.0.74 () {58 vars in 1275 bytes} [Wed Jul 27 16:42:06 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:06.437975 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:06.438517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:06.444510 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:06.444988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.445760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:06.446200 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.454583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:06.455341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:06.461676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:06.462275 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.463148 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:06.463688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:06.788276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:06.799386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b748d643-1a50-4971-895c-356796f5663b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1594 microversion: 2.1 time: 0.365746 Jul 27 16:42:06.806990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:06.816624 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 416/810] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:06 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1594 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:06.828538 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:06.830097 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:06.831283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bc7deb1e-a753-41b5-88ee-908ec198c5a5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.381782 Jul 27 16:42:06.832312 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 395/811] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:06 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:07.584997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-b791a4c1-1a6a-4163-b430-8ff6a39c3186 req-c8c50d03-0d0e-4a30-9c5b-7fa3a30a07cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135ef04d-6996-46ef-90a6-39ad9504292b", "tag": "f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:07.602825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-b791a4c1-1a6a-4163-b430-8ff6a39c3186 req-c8c50d03-0d0e-4a30-9c5b-7fa3a30a07cb service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:07.604468 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-b791a4c1-1a6a-4163-b430-8ff6a39c3186 req-c8c50d03-0d0e-4a30-9c5b-7fa3a30a07cb service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:07.628408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-b791a4c1-1a6a-4163-b430-8ff6a39c3186 req-c8c50d03-0d0e-4a30-9c5b-7fa3a30a07cb service nova] Creating event network-changed:f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c for instance 135ef04d-6996-46ef-90a6-39ad9504292b on hv-cinder-84969 Jul 27 16:42:07.634765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-b791a4c1-1a6a-4163-b430-8ff6a39c3186 req-c8c50d03-0d0e-4a30-9c5b-7fa3a30a07cb service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056014 Jul 27 16:42:07.636354 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 417/812] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:07.857453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:07.860695 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:07.871636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:07.872535 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:07.874908 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:07.876361 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:08.111612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:08.124259 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:08.125860 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:08.132292 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fff8640d-efe0-4ebe-97f9-2ace9dbc1f3e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1744 microversion: 2.20 time: 0.280195 Jul 27 16:42:08.135016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 396/813] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:07 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1744 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:09.180104 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:09.185146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:09.193446 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:09.197350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:09.198467 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:09.198993 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:09.319611 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-314b7a26-8db2-4dfc-8112-4d2f3c7cbee4 req-ea253a39-a3f3-4426-869f-950a6fe68194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:09.343480 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-314b7a26-8db2-4dfc-8112-4d2f3c7cbee4 req-ea253a39-a3f3-4426-869f-950a6fe68194 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:09.346212 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-314b7a26-8db2-4dfc-8112-4d2f3c7cbee4 req-ea253a39-a3f3-4426-869f-950a6fe68194 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:09.379527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-314b7a26-8db2-4dfc-8112-4d2f3c7cbee4 req-ea253a39-a3f3-4426-869f-950a6fe68194 service nova] Creating event network-changed:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:42:09.392065 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-314b7a26-8db2-4dfc-8112-4d2f3c7cbee4 req-ea253a39-a3f3-4426-869f-950a6fe68194 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075628 Jul 27 16:42:09.394293 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 397/814] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:09.451380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:09.461097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:09.466593 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:09.470574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9f396139-944b-431b-8c42-ced026116df5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1744 microversion: 2.20 time: 0.310821 Jul 27 16:42:09.473902 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 418/815] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:09 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:10.500753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:10.502257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:10.510833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:10.512012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:10.513914 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:10.515130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:10.766250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:10.781758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:10.783676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:10.788195 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4189fcbd-c013-4505-a3a8-c638b322b224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.292246 Jul 27 16:42:10.809049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 398/816] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:10 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:10.846802 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-274171055"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:10.847320 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:10.866444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-4c5d757b-b8c5-4d79-b7ec-ca4b6425af3b req-5ae7eae5-d281-43b2-a012-ff8f29d114b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "name": "network-vif-plugged", "status": "completed", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:10.871910 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:10.874639 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:10.876927 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:10.879022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:10.883023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-4c5d757b-b8c5-4d79-b7ec-ca4b6425af3b req-5ae7eae5-d281-43b2-a012-ff8f29d114b2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:10.885052 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-4c5d757b-b8c5-4d79-b7ec-ca4b6425af3b req-5ae7eae5-d281-43b2-a012-ff8f29d114b2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:10.916198 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-4c5d757b-b8c5-4d79-b7ec-ca4b6425af3b req-5ae7eae5-d281-43b2-a012-ff8f29d114b2 service nova] Creating event network-vif-plugged:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:42:10.928276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-4c5d757b-b8c5-4d79-b7ec-ca4b6425af3b req-5ae7eae5-d281-43b2-a012-ff8f29d114b2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065325 Jul 27 16:42:10.930559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 399/817] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:42:11.114888 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.network.security_group_api [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Adding security group df9882dd-64c8-474b-a102-775f80848ff0 to port 82adc233-9cd1-47cb-9a9f-6589c38dcd85 Jul 27 16:42:11.639430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-093c8b0a-f532-409a-a0be-5c565fac949d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/action" status: 202 len: 0 microversion: 2.1 time: 0.797072 Jul 27 16:42:11.642284 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 419/818] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:42:10 2022] POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:42:11.652423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:11.654016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:11.663141 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-1c652e04-6911-413c-a16f-d16cdfd572ec req-ed151244-8b1d-4518-8a17-bb82d9f1eaad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:11.674658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:11.675550 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:11.676377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:11.676827 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:11.684919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-1c652e04-6911-413c-a16f-d16cdfd572ec req-ed151244-8b1d-4518-8a17-bb82d9f1eaad service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:11.685726 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-1c652e04-6911-413c-a16f-d16cdfd572ec req-ed151244-8b1d-4518-8a17-bb82d9f1eaad service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:11.720689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-1c652e04-6911-413c-a16f-d16cdfd572ec req-ed151244-8b1d-4518-8a17-bb82d9f1eaad service nova] Creating event network-changed:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:42:11.727440 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-1c652e04-6911-413c-a16f-d16cdfd572ec req-ed151244-8b1d-4518-8a17-bb82d9f1eaad service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069966 Jul 27 16:42:11.728771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 420/819] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:11.818984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:11.819865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:11.844387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:11.846276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:11.849491 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:11.854146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:12.181841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:12.197670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:12.221763 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-98d34f99-15fa-4ebb-a48b-7b736c142c18 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1759 microversion: 2.1 time: 0.574372 Jul 27 16:42:12.248101 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:12.249358 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 400/820] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:11 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1759 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:42:12.251436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:12.254157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-05610a1a-c6e8-4c34-adeb-e2af6741e40d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.440688 Jul 27 16:42:12.255480 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 421/821] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:11 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:13.291275 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:13.292744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:13.303151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:13.303970 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:13.305019 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:13.305671 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:13.475176 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:13.477533 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:13.485895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:13.487727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:13.488941 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d1b0903b-b7e0-4771-8761-d7cf053bd49a tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.203542 Jul 27 16:42:13.489494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 401/822] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:13 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:14.511924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:14.512947 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:14.520763 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:14.521707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:14.523178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:14.523679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:14.687297 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:14.697398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:14.699470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:14.700725 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cb86f789-4e42-47cd-9789-4fc19f31ef6e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.192713 Jul 27 16:42:14.701797 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 422/823] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:14 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:15.727201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:15.728103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:15.738796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:15.739236 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:15.740007 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:15.740436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:15.892493 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:15.901818 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:15.905626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:15.905626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-67072cb5-4af0-4adf-b357-a354c7274327 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.181658 Jul 27 16:42:15.905626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 402/824] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:15 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:16.929338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:16.930599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:16.937925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:16.938606 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:16.939387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:16.939828 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:17.085702 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:17.094642 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:17.096337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:17.097696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-de318a4e-6528-4865-8873-be047ecba2ad tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.172966 Jul 27 16:42:17.098407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 423/825] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:16 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:18.122288 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:18.122903 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:18.131832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:18.132276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:18.133079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:18.133679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:18.315748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:18.328920 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:18.330744 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:18.332136 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-93718157-f622-4765-9615-66a2bef76282 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.213940 Jul 27 16:42:18.332817 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 403/826] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:18 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:19.356818 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:19.363504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:19.371773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:19.372310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:19.373395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:19.377471 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:19.550428 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:19.559832 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:19.562893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:19.564243 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a161548f-377b-419b-9d61-512945618e27 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1739 microversion: 2.20 time: 0.212508 Jul 27 16:42:19.565338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 424/827] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:19 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:20.590291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:20.591567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:20.601696 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:20.602223 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:20.603284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:20.603922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:20.834388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:20.847398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:20.848926 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:20.850161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-777fc0fe-5e9a-4379-a99f-d516398b4a1f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1721 microversion: 2.20 time: 0.266415 Jul 27 16:42:20.850821 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 404/828] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:20 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:21.873589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:21.875257 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:21.883993 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:21.884450 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:21.885368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:21.885808 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:22.024585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:22.033067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:22.034552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:22.035691 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f028dce1-fd43-4217-bcb9-e16a182fe1e3 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1721 microversion: 2.20 time: 0.166251 Jul 27 16:42:22.036224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 425/829] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:21 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:22.797745 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-14179d22-8736-4553-95f3-789f841d370c req-779c4482-80a6-4eba-8076-b8e3fb7b9365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "name": "network-vif-unplugged", "status": "completed", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:22.814118 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-14179d22-8736-4553-95f3-789f841d370c req-779c4482-80a6-4eba-8076-b8e3fb7b9365 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:22.814866 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-14179d22-8736-4553-95f3-789f841d370c req-779c4482-80a6-4eba-8076-b8e3fb7b9365 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:22.829460 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-14179d22-8736-4553-95f3-789f841d370c req-779c4482-80a6-4eba-8076-b8e3fb7b9365 service nova] Creating event network-vif-unplugged:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:42:22.834935 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-14179d22-8736-4553-95f3-789f841d370c req-779c4482-80a6-4eba-8076-b8e3fb7b9365 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041089 Jul 27 16:42:22.835691 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 405/830] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:23.063939 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:23.065039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:23.074975 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:23.075855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:23.078078 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:23.078862 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:23.226933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:23.235603 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:23.237140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:23.238379 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0bc98a9b-788d-40f4-9cc0-5d90ca7ab658 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1721 microversion: 2.20 time: 0.182120 Jul 27 16:42:23.238821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 426/831] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:23 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:23.500314 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:23.501252 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:23.509558 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:23.510753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:23.511713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:23.512301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:23.536766 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a1f04d65-77b7-45af-bc77-6f53776cdbef tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/ips" status: 200 len: 149 microversion: 2.1 time: 0.041720 Jul 27 16:42:23.537624 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 406/832] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:42:23 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:42:24.262075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:24.262692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:24.269695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.270116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.271180 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.271640 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.451907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:24.463717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:24.465956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:24.467354 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-113c87c7-bccb-437d-a0b5-ca955442e5f8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1664 microversion: 2.20 time: 0.209227 Jul 27 16:42:24.467984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 427/833] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:24 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:24.490556 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "598ca528-682b-4c3f-b3c8-31736e915737"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:24.493031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:24.500132 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.500581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.501378 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.501815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.787649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-13a814a7-d5e7-4cf2-908c-80cdb668f135 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301160 Jul 27 16:42:24.788238 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 407/834] 10.222.0.74 () {62 vars in 1364 bytes} [Wed Jul 27 16:42:24 2022] POST /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 16:42:24.886402 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdf414ee-2b34-4979-9402-b377bf5b09c2"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:24.888688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:24.894721 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.895169 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.895929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.896360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.927968 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:24.928574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:24.935187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.935672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:24.937048 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:24.937521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:25.177832 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-adc8e20f-dd6a-4c92-b199-6c6bc8857fdb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "POST /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295157 Jul 27 16:42:25.178801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 428/835] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:42:24 2022] POST /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:42:25.242753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4bb67ee2-3673-4714-81ba-a812b6c5c37b tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-volume_attachments/598ca528-682b-4c3f-b3c8-31736e915737" status: 202 len: 0 microversion: 2.20 time: 0.319435 Jul 27 16:42:25.243615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 408/836] 10.222.0.74 () {60 vars in 1457 bytes} [Wed Jul 27 16:42:24 2022] DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-volume_attachments/598ca528-682b-4c3f-b3c8-31736e915737 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:42:25.306291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:25.306969 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:25.313305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:25.313751 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:25.314504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:25.314933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:25.350262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124236) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 16:42:25.405625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:25.419394 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3e7a0883-83e8-4676-916b-ddbeb553ba10 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "POST /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/action" status: 202 len: 0 microversion: 2.20 time: 0.118302 Jul 27 16:42:25.423367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 429/837] 10.222.0.74 () {62 vars in 1319 bytes} [Wed Jul 27 16:42:25 2022] POST /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:42:25.428798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:25.429584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:25.435984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:25.436501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:25.437554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:25.438257 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:25.593126 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:25.607565 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:25.609138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:25.610367 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ed5310fc-2ab4-47c4-aee6-cb12504bedeb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1672 microversion: 2.20 time: 0.185476 Jul 27 16:42:25.611164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 409/838] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:25 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:26.640765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:26.641470 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:26.649344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:26.650562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:26.651851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:26.652303 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:26.798246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:26.806089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:26.807571 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:26.808706 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0e61b662-bc3d-465d-8e6e-0d108c425165 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1672 microversion: 2.20 time: 0.173600 Jul 27 16:42:26.809278 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 430/839] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:26 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:27.835091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:27.836032 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:27.847029 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:27.847699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:27.848963 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:27.849748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:28.021437 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:28.031300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:28.033173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:28.034438 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-78f9944a-ff83-4712-83ca-868c8a57a122 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.205869 Jul 27 16:42:28.041296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 410/840] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:27 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:29.057692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:29.058332 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:29.060750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:29.067753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:29.068296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:29.069344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:29.069854 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:29.214264 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:29.223715 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:29.225524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:29.226882 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8a2b09b3-5095-4143-8f87-6382c4fa2fc0 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.173071 Jul 27 16:42:29.227637 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 431/841] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:29 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:30.250659 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:30.251283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:30.258078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:30.258539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:30.259466 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:30.259893 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:30.444189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:30.453886 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:30.455767 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:30.457291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-21dd7e4c-0c9d-4d30-91ae-b9f305840599 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.211006 Jul 27 16:42:30.473563 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 411/842] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:30 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:31.482945 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:31.483633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:31.490055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:31.490585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:31.491347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:31.491780 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:31.653461 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:31.664280 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:31.665900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:31.667078 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ce7ea452-a062-4594-811c-f2685dfca224 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.188973 Jul 27 16:42:31.667664 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 432/843] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:31 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:32.691056 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:32.691702 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:32.694284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=46 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:32.699946 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:32.700397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:32.701929 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:32.702407 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:32.858997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:32.867478 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:32.869643 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:32.871225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-da0a7949-3fa8-4502-9f0e-25839df8a272 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.183981 Jul 27 16:42:32.872439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 412/844] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:32 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:33.894444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:33.895159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:33.902349 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:33.902803 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:33.903581 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:33.904020 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:34.054726 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:34.063141 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:34.064917 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:34.066294 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-28142db0-4b18-409b-b41b-2220cfe66844 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.175784 Jul 27 16:42:34.066891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 433/845] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:33 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:35.090968 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:35.092288 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:35.099296 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:35.099741 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:35.100501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:35.100957 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:35.245987 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:35.254826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:35.256544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:35.258050 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c0b9621b-71b8-469a-95e4-089df35a787d tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.170945 Jul 27 16:42:35.258605 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 413/846] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:35 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:35.944561 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:35.947552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:35.957822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:35.957822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:35.957822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:35.957822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:36.044068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-853b95f0-1b37-4488-a8fc-62ec08ad869c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/action" status: 202 len: 0 microversion: 2.1 time: 0.103246 Jul 27 16:42:36.045289 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 434/847] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:42:35 2022] POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:42:36.054282 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:36.055414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:36.064751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:36.065424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:36.067115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:36.067942 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:36.074705 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:36.283170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:36.283358 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:36.283873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:36.290060 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:36.290509 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:36.291227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1880bf27-c62f-4e48-9f0d-9600f045eef6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1751 microversion: 2.1 time: 0.241185 Jul 27 16:42:36.291362 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:36.291704 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:36.291811 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 414/848] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:36 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:36.458036 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:36.466017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:36.467585 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:36.468746 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-80c3f234-cd5e-4721-8106-71d697273ade tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.190446 Jul 27 16:42:36.469669 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 435/849] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:36 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:37.314220 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:37.314852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:37.322115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:37.322917 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:37.323934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:37.324627 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:37.488810 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:37.492835 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:37.494207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:37.497441 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f106201e-8bfe-4a5a-be97-4a3499d11475 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1751 microversion: 2.1 time: 0.186977 Jul 27 16:42:37.498169 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 415/850] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:37 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:37.501602 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:37.502318 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:37.503350 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:37.504002 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:37.650760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:37.659928 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:37.661471 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:37.662625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8f5f8dde-5c22-463a-8a70-2158be5ad352 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.173851 Jul 27 16:42:37.663174 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 436/851] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:37 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:38.519113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:38.519721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:38.526313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:38.526792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:38.527570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:38.528000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:38.671582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:38.683223 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-23c73ccf-23c6-4a7c-afb1-1e6d4c730e08 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1751 microversion: 2.1 time: 0.167935 Jul 27 16:42:38.683807 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 416/852] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:38 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:38.686326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:38.686943 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:38.693628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:38.694072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:38.694831 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:38.695264 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:38.827805 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:38.837870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:38.839381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:38.840577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d8ded2fd-4e89-4f25-8bf6-3bae7edec607 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.158353 Jul 27 16:42:38.841186 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 437/853] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:38 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:39.705066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:39.705676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:39.713114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:39.713805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:39.715072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:39.715530 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:39.858019 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:39.866015 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3d71fcd2-48e7-4c60-9532-f094988d5e2b tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1751 microversion: 2.1 time: 0.165415 Jul 27 16:42:39.866637 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 417/854] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:39 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:39.867821 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:39.868582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:39.875129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:39.875577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:39.877205 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:39.877667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:40.013455 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:40.022374 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:40.023856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:40.025034 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ffbcd83a-34ed-469e-8dba-43966abd8c20 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.161322 Jul 27 16:42:40.025582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 438/855] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:39 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:40.887302 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:40.888311 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:40.895983 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:40.896531 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:40.897737 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:40.898503 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.048395 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:41.050925 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:41.057757 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:41.058309 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.059398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:41.060104 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.396431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:41.412251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:41.420809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:41.424373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:41.434126 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8b565dab-12f3-4218-8467-f54417be855c tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.390336 Jul 27 16:42:41.435714 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f9919809-4be2-49cc-a9ac-77e3d4f6536c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1751 microversion: 2.1 time: 0.552314 Jul 27 16:42:41.450770 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 439/856] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:41 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:41.451808 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 418/857] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:40 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1751 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:41.474583 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:41.475160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:41.481762 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:41.482341 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.483184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:41.483694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.721776 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lazy-loading 'services' on Instance uuid 55626f53-2e25-4155-8c30-c86a7f381f95 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:42:41.793498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-34e08361-b458-4445-a921-88bc3df5ca1b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments/bdf414ee-2b34-4979-9402-b377bf5b09c2" status: 202 len: 0 microversion: 2.1 time: 0.322390 Jul 27 16:42:41.794756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 440/858] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:42:41 2022] DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments/bdf414ee-2b34-4979-9402-b377bf5b09c2 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 16:42:41.806479 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:41.808974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:41.816041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:41.816505 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.817403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:41.817955 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:41.849923 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-34dfbda5-33f8-44b5-89eb-648ba76f1a1f tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050569 Jul 27 16:42:41.850512 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 419/859] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:42:41 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:42:42.459453 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:42.460145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:42.460272 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:42.460971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:42.466564 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.467003 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.467756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.468924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.469051 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.469051 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.469945 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.470394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.689909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:42.695849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:42.698965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:42.701123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:42.702552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1f783c3a-ed9f-4e92-becb-c55c865d9e14 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.246323 Jul 27 16:42:42.703122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 420/860] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:42 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:42.704062 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-733dbcbb-e8be-4cbf-a461-a8d5d8219c68 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.249417 Jul 27 16:42:42.704603 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 441/861] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:42 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:42.862355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:42.864594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:42.871144 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.871597 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.872382 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.872883 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.906546 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fa298b70-bb9b-4234-95bc-2b7df2529e3b tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047974 Jul 27 16:42:42.912749 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 421/862] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:42:42 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:42:42.972996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:42.973497 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:42.979529 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.979988 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.980756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:42.981224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:42.989810 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-8b26375f-d8a2-4a22-9fcb-ddaaa9059fec req-5e4c0c21-f0b9-425e-b8e5-4f29b4e9ffa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "name": "network-vif-plugged", "status": "completed", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:43.001021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-8b26375f-d8a2-4a22-9fcb-ddaaa9059fec req-5e4c0c21-f0b9-425e-b8e5-4f29b4e9ffa2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.001569 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-8b26375f-d8a2-4a22-9fcb-ddaaa9059fec req-5e4c0c21-f0b9-425e-b8e5-4f29b4e9ffa2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.012996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:42:43.015270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-8b26375f-d8a2-4a22-9fcb-ddaaa9059fec req-5e4c0c21-f0b9-425e-b8e5-4f29b4e9ffa2 service nova] Creating event network-vif-plugged:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:42:43.020805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-8b26375f-d8a2-4a22-9fcb-ddaaa9059fec req-5e4c0c21-f0b9-425e-b8e5-4f29b4e9ffa2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Jul 27 16:42:43.021499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 422/863] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:42:43.110449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2c4bfc67-8ebc-47a7-9b25-a8c7545d2296 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 204 len: 0 microversion: 2.1 time: 0.140969 Jul 27 16:42:43.111405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 442/864] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:42:42 2022] DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:42:43.120689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:43.121499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:43.128592 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.129089 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.129833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.130264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.261726 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:43.269114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-fedfcab4-3f5c-4483-9843-7f447af7d79c tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1681 microversion: 2.1 time: 0.153040 Jul 27 16:42:43.269659 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 423/865] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:43 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:43.725684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:43.726357 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:43.726703 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:43.727220 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:43.733738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.734187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.734633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.734960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.735072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.735396 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.735827 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:43.736258 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:43.741105 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:43.951018 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:43.954989 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:43.959055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b4b9e373-a316-4816-bb1a-fbcbee11634c tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.237348 Jul 27 16:42:43.959624 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 424/866] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:43 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:43.962918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:43.964408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:43.965577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a2a00524-2fa1-47e3-a2e9-6887819c70c8 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.243761 Jul 27 16:42:43.966121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 443/867] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:43 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:44.304405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:44.315755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:44.325567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:44.325567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:44.325567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:44.325567 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:44.457473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:44.465104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3e4325ac-8c5d-4291-8b8a-4e41d62402bb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1681 microversion: 2.1 time: 0.178538 Jul 27 16:42:44.465660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 425/868] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:44 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:44.981199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:44.981817 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:44.988309 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:44.988761 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:44.988883 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:44.989404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:44.989562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:44.990003 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:44.995826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:44.996326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:44.997112 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:44.997539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:45.197956 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:45.203377 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:45.206475 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:45.208004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:45.209207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-dda87f07-cf35-463f-93d2-6f8870599d28 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.224259 Jul 27 16:42:45.209768 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 426/869] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:44 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 16:42:45.211473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f64d041d-3e50-442a-af5b-75d64fd69039 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.234216 Jul 27 16:42:45.212097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 444/870] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:44 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:45.486829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:45.487455 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:45.493527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:45.493979 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:45.494748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:45.495183 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:45.625965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:45.633282 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3605b925-0488-4f69-b18a-4d4ad025264a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1681 microversion: 2.1 time: 0.150273 Jul 27 16:42:45.633853 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 427/871] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:45 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:46.233860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:46.239958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:46.240570 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:46.244041 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:46.250580 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.251390 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.252044 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.252182 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.252492 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.252625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.253624 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.254069 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.570810 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:46.581396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:46.583466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:46.585886 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-652f7183-c07c-42d2-8b86-0281499f4dee tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1730 microversion: 2.20 time: 0.356189 Jul 27 16:42:46.586475 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 445/872] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:46 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1730 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:46.594408 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:46.602998 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-557c3fd7-3dbe-4f19-8e08-da354fee82f9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.366747 Jul 27 16:42:46.606310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-91f34482-ae92-4ad3-92ee-ff3159d05525 req-86bb49b3-3f83-478e-8c68-cf1277371f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55626f53-2e25-4155-8c30-c86a7f381f95", "name": "network-vif-deleted", "tag": "6993eaf5-c8ad-4936-9c06-76702442c3cf"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:46.617398 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 428/873] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:46 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:46.623757 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-91f34482-ae92-4ad3-92ee-ff3159d05525 req-86bb49b3-3f83-478e-8c68-cf1277371f39 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.624205 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-91f34482-ae92-4ad3-92ee-ff3159d05525 req-86bb49b3-3f83-478e-8c68-cf1277371f39 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.636955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-91f34482-ae92-4ad3-92ee-ff3159d05525 req-86bb49b3-3f83-478e-8c68-cf1277371f39 service nova] Creating event network-vif-deleted:6993eaf5-c8ad-4936-9c06-76702442c3cf for instance 55626f53-2e25-4155-8c30-c86a7f381f95 on hv-cinder-84969 Jul 27 16:42:46.643619 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-91f34482-ae92-4ad3-92ee-ff3159d05525 req-86bb49b3-3f83-478e-8c68-cf1277371f39 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044117 Jul 27 16:42:46.644409 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 446/874] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:46.664228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:46.665261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:46.673427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.674504 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.675760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:46.676405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:46.752943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140059c5b30c426ab6d7f1236eb5f684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcc91e5911a4a418118b3775cfe4b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:46.763230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-20a6c628-5454-465f-a7a6-a895ed0b541e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 200 len: 1326 microversion: 2.1 time: 0.111672 Jul 27 16:42:46.774326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 429/875] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:46 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:47.612043 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:47.612748 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:47.619853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:47.620303 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:47.621099 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:47.621537 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:47.624796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:47.625509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:47.634424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:47.635022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:47.635807 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:47.636249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:47.826427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:47.834765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:47.836448 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:47.837666 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3b494b7f-c75a-4137-a14c-af68f63d6afb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1717 microversion: 2.20 time: 0.229833 Jul 27 16:42:47.838423 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 447/876] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:42:47 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1717 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:42:47.843383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:47.843990 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:47.847871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:47.850218 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:47.850659 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:47.851410 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:47.851835 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:47.859796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-af8e8fed-f01d-4840-9e04-3425ab5de8b0 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.239592 Jul 27 16:42:47.860972 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 430/877] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:47 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:42:47.870984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 HTTP/1.1 Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:42:47.873511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:47.874911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '55626f53-2e25-4155-8c30-c86a7f381f95'} Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:47.875716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:47.877108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:47.878271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:47.878271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-68240f60-ea33-44d9-9037-d55c757f83a6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 404 len: 111 microversion: 2.1 time: 0.035631 Jul 27 16:42:47.878271 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 448/878] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:47 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:47.884299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-51986e58-fbfb-4953-ba49-21b6e25b4eaa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '.version_select at 0x7ff56c336160>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:47.902620 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-51986e58-fbfb-4953-ba49-21b6e25b4eaa tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549721005" status: 202 len: 0 microversion: 2.1 time: 0.022114 Jul 27 16:42:47.903151 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 431/879] 10.222.0.74 () {58 vars in 1218 bytes} [Wed Jul 27 16:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549721005 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:42:48.883015 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:48.883771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:48.890661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:48.891112 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:48.891935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:48.892369 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:49.042499 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:49.050920 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8a82ccdc-2257-4b05-89cb-1fb14b5e902e tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.171951 Jul 27 16:42:49.051465 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 449/880] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:48 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:49.650675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:49.651232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:49.657960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:49.658509 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:49.659283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:49.659738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:49.674374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 HTTP/1.1 Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:42:49.676114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.677449 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '55626f53-2e25-4155-8c30-c86a7f381f95'} Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:49.678173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.679876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.681781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:49.681781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7c0303ce-62c2-4a5e-a9f6-7d5a989012cb tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 404 len: 111 microversion: 2.1 time: 0.031341 Jul 27 16:42:49.681781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 432/881] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:42:49 2022] DELETE /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:49.685844 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:49.686452 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 55626f53-2e25-4155-8c30-c86a7f381f95] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:49.692223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:49.692663 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:49.693490 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:49.693860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:49.707052 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 HTTP/1.1 Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:42:49.708553 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.710110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '55626f53-2e25-4155-8c30-c86a7f381f95'} Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:49.711063 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. Jul 27 16:42:49.712223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:49.713345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance 55626f53-2e25-4155-8c30-c86a7f381f95 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:49.713345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-10bbd560-6c89-423b-854f-048b17dc9034 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95" status: 404 len: 111 microversion: 2.1 time: 0.027864 Jul 27 16:42:49.713345 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 450/882] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:49 2022] GET /compute/v2.1/servers/55626f53-2e25-4155-8c30-c86a7f381f95 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:50.072214 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:50.072829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:50.079549 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.079996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.080758 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.081226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.085226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=100 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:50.234084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:50.242261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1185b3eb-adec-441f-a858-0be530a9b156 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.174381 Jul 27 16:42:50.242829 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 433/883] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:50 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:50.845893 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:50.846384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:50.852678 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.853158 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.853909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.854339 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.867680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 HTTP/1.1 Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:42:50.869250 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.870892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'c21a1ed6-5d26-46b1-8222-4b4fb534abb5'} Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:50.871686 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.873550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.874773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:50.874773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a0609f39-5585-476e-859b-a99f79d80432 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 404 len: 111 microversion: 2.1 time: 0.028732 Jul 27 16:42:50.874773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 451/884] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:42:50 2022] DELETE /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:50.879984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:50.880602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c21a1ed6-5d26-46b1-8222-4b4fb534abb5] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:50.887254 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.887704 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.888477 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.888937 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.901958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 HTTP/1.1 Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:42:50.903489 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.905576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c21a1ed6-5d26-46b1-8222-4b4fb534abb5'} Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:50.906428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. Jul 27 16:42:50.907881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.909216 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance c21a1ed6-5d26-46b1-8222-4b4fb534abb5 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:50.909216 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a3cc27e2-555a-471f-860c-402bff07c2b5 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5" status: 404 len: 111 microversion: 2.1 time: 0.029438 Jul 27 16:42:50.909216 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 434/885] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:50 2022] GET /compute/v2.1/servers/c21a1ed6-5d26-46b1-8222-4b4fb534abb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:50.914359 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:50.914867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:50.921259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.921710 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.922473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.922912 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.935971 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 HTTP/1.1 Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:42:50.937531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.939055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '6b72f0b5-a0b5-458b-9cbb-7216d34be718'} Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:50.940073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.941617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.943019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:50.943019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-eae7d461-1a44-46e0-affa-02bbd7b43d79 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 404 len: 111 microversion: 2.1 time: 0.028359 Jul 27 16:42:50.943019 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 452/886] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:42:50 2022] DELETE /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:50.947209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:50.947824 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: 6b72f0b5-a0b5-458b-9cbb-7216d34be718] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:50.954123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.954579 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.955353 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:50.955790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:50.970234 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 HTTP/1.1 Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:42:50.971799 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.973405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '6b72f0b5-a0b5-458b-9cbb-7216d34be718'} Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:50.974855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. Jul 27 16:42:50.976077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:50.977717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance 6b72f0b5-a0b5-458b-9cbb-7216d34be718 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:50.977717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-64ad7ca6-66be-4abe-a2e6-4d79f2bf18d6 tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718" status: 404 len: 111 microversion: 2.1 time: 0.029892 Jul 27 16:42:50.977717 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 435/887] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:50 2022] GET /compute/v2.1/servers/6b72f0b5-a0b5-458b-9cbb-7216d34be718 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:51.265764 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:51.266366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:51.273544 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:51.274004 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:51.274773 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:51.275214 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:51.464793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:51.473950 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-96f41074-a12e-4484-bdf6-4bffc43ac90a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.213432 Jul 27 16:42:51.474656 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 453/888] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:51 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:51.684720 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:51.685730 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:51.691754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:51.692197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:51.692984 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:51.693412 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:51.719832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8a048d93-5b2e-4c5b-9897-1c464718ebe7 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/ips" status: 200 len: 144 microversion: 2.1 time: 0.038704 Jul 27 16:42:51.720834 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 436/889] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:42:51 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:52.117500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:52.118010 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:52.125093 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:52.125542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:52.126320 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:52.126740 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:52.141490 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e HTTP/1.1 Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:42:52.143024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.144688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'c7fb7d3a-2581-4c62-9d19-7636961df56e'} Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:52.145542 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.146974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.148365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:52.148365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f0448877-dddb-4aea-acb7-7fce80e12f4a tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 404 len: 111 microversion: 2.1 time: 0.030692 Jul 27 16:42:52.148365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 454/890] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:42:52 2022] DELETE /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:52.157589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:52.158207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] [instance: c7fb7d3a-2581-4c62-9d19-7636961df56e] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:52.164972 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:52.165433 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:52.166202 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:52.166648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:52.181206 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] HTTP exception thrown: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Request method failure captured: Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e HTTP/1.1 Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlzhsiiMq2kZmiefZSHSdWnw00Reiqy2VCaORQJWInZes6gE4r6dNoLyCFiMIf3b00PdRkCbIsyTva1-8b0N0Ebtejk1hg9rZ7j3ciUL1c-JsoMvOF76_5G0FNcWM9-eOxn3DzMpNr573NkP9Tr7e4Jz1CC2rJv-0cf6HRCoDmpUJY Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:42:52.182734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/ebcc91e5911a4a418118b3775cfe4b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: ebcc91e5911a4a418118b3775cfe4b76 Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967947114 Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 140059c5b30c426ab6d7f1236eb5f684 Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeNegativeTest-1967947114-project Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.184279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c7fb7d3a-2581-4c62-9d19-7636961df56e'} Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:42:52.189406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. Jul 27 16:42:52.191034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:42:52.192310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] Returning 404 to user: Instance c7fb7d3a-2581-4c62-9d19-7636961df56e could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:42:52.192310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0e2e52ab-43f4-4e45-95ac-ddbb9ec8ef9e tempest-AttachVolumeNegativeTest-1967947114 tempest-AttachVolumeNegativeTest-1967947114-project] 10.222.0.74 "GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e" status: 404 len: 111 microversion: 2.1 time: 0.030467 Jul 27 16:42:52.192310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 437/891] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:52 2022] GET /compute/v2.1/servers/c7fb7d3a-2581-4c62-9d19-7636961df56e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:52.496110 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:52.497102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:52.504051 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:52.504847 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:52.505859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:52.506978 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:52.667980 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:52.676514 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-40d6a7a3-f5d9-4694-a08d-546980b6f2a6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.184690 Jul 27 16:42:52.689305 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 455/892] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:52 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:53.078980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98e39ebe-f232-4141-a5d4-f8988a4b64ff"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:42:53.081481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:53.087729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:53.088191 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:53.089013 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:53.089469 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:53.574630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-394eceec-f416-46e5-8861-efab1be3e52b tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499444 Jul 27 16:42:53.586444 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 438/893] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:42:53 2022] POST /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:42:53.697309 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:53.697929 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:53.716464 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:53.717074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:53.717687 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:53.718127 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:53.984349 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:53.995325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-75c86241-c3c3-4e5f-a1c2-45f262f80c11 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.301605 Jul 27 16:42:54.033282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 456/894] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:53 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:55.038014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:55.039392 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:55.045881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:55.046340 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:55.047122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:55.047562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:55.278683 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:55.288025 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-285084c3-e347-4c26-bf58-257ef2bb45f5 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.255488 Jul 27 16:42:55.288828 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 439/895] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:55 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:56.309892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:56.311079 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:56.318347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:56.318870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:56.319716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:56.320223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:56.476990 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:56.484752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1434a6fa-cb34-4b2a-b7fe-9a6eefd5c6ae tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.178846 Jul 27 16:42:56.485324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 457/896] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:56 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:57.506105 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:57.506715 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:57.514853 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:57.515303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:57.516083 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:57.516515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:57.736859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:57.745416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3190eaa4-0a36-4b62-b94e-e635a0ef4844 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.243142 Jul 27 16:42:57.746047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 440/897] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:57 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:58.768054 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:58.768662 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:58.775095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:58.775532 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:58.776275 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:58.776708 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:58.916689 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:42:58.925813 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b5b5a700-639c-4974-b9ea-ed8fb75ed407 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.161553 Jul 27 16:42:58.929246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 458/898] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:58 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:42:59.946117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:42:59.946652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:42:59.953155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:59.953594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:42:59.954352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:42:59.954781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:00.100514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:00.109041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e8f270d7-14fe-4b57-a4cd-851df5a6f387 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.166876 Jul 27 16:43:00.109599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 441/899] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:42:59 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:01.129967 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:01.130586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:01.133074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:01.139279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:01.139731 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:01.140504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:01.140966 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:01.287638 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:01.295591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5a214919-d708-4e22-93a7-a2b5e321e72d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.169670 Jul 27 16:43:01.296142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 459/900] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:01 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:02.195855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:02.198228 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:02.205578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:02.206034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:02.206805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:02.207247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:02.235857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a7709f33-5288-43e2-aee1-241fed0083cb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Jul 27 16:43:02.236397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 442/901] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:43:02 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:02.246849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:02.247343 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:02.254406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:02.254855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:02.255620 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:02.256056 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:02.284042 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-992693e5-fdd6-487a-af92-ccfd78540358 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/98e39ebe-f232-4141-a5d4-f8988a4b64ff" status: 200 len: 194 microversion: 2.1 time: 0.041131 Jul 27 16:43:02.284628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 460/902] 10.222.0.74 () {58 vars in 1413 bytes} [Wed Jul 27 16:43:02 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/98e39ebe-f232-4141-a5d4-f8988a4b64ff => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:02.316736 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:02.317393 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:02.323879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:02.323879 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:02.324523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:02.324982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:02.470395 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:02.478591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-38c9aa2d-17e2-4812-8560-5f48eb0032d4 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.165539 Jul 27 16:43:02.479245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 443/903] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:02 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:03.500253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:03.500918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:03.507321 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:03.507766 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:03.508521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:03.508981 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:03.655853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:03.664000 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8804147e-0d6b-464c-b311-04c0a430ec43 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.167552 Jul 27 16:43:03.664563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 461/904] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:03 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:04.685165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:04.685835 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:04.688554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:04.694672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:04.695119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:04.695891 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:04.696326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:04.843539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:04.851934 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ca8c82fe-6e5a-4093-9a4f-b9e7561d78e6 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.170863 Jul 27 16:43:04.852493 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 444/905] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:04 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:05.873906 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:05.874550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:05.881162 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:05.881617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:05.882376 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:05.882809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:06.029296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:06.037580 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a490e2a1-b53c-46d6-a28f-7ce9f6873ed9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.168071 Jul 27 16:43:06.038137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 462/906] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:05 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:07.058562 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:07.059179 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:07.065776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:07.066225 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:07.066990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:07.067428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:07.206262 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:07.214501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5c379af4-14e3-4a3f-9610-b25d40c484bb tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1756 microversion: 2.1 time: 0.159827 Jul 27 16:43:07.215197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 445/907] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:07 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:08.236554 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:08.237186 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:08.243870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:08.244323 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:08.245119 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:08.245555 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:08.399201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:08.403198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=100 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:08.409583 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c2afd97a-b186-48ef-8f7e-932c445d900f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1759 microversion: 2.1 time: 0.176346 Jul 27 16:43:08.411156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 463/908] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:08 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:08.886223 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11f546b9-2bae-4cbd-a500-6fee02c13a54"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:08.888615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:08.895234 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:08.895684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:08.896452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:08.896906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:09.127738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3f9b58e7-df0f-48d4-8ff9-8d9d177ceac0 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "POST /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245580 Jul 27 16:43:09.128355 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 446/909] 10.222.0.74 () {60 vars in 1323 bytes} [Wed Jul 27 16:43:08 2022] POST /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:16.707605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:16.709787 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:16.717196 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:16.722641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:16.723462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:16.724073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:16.763710 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7794c839-14cc-4d52-8367-8604acc406c4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059359 Jul 27 16:43:16.765095 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 464/910] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:43:16 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:16.924411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:16.926525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:16.934895 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:16.935807 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:16.936996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:16.937693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:17.045303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d3e1b559-1aa0-4416-97bc-6e9d8ab69f52 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/98e39ebe-f232-4141-a5d4-f8988a4b64ff" status: 200 len: 194 microversion: 2.1 time: 0.128982 Jul 27 16:43:17.047964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 447/911] 10.222.0.74 () {58 vars in 1413 bytes} [Wed Jul 27 16:43:16 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/98e39ebe-f232-4141-a5d4-f8988a4b64ff => generated 194 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:17.058657 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:17.059262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:17.067873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:17.068335 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:17.069175 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:17.069619 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:17.197774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'services' on Instance uuid 135ef04d-6996-46ef-90a6-39ad9504292b {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:43:17.302630 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8cb97112-d050-46e3-8eea-b65dd9680feb tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/98e39ebe-f232-4141-a5d4-f8988a4b64ff" status: 202 len: 0 microversion: 2.1 time: 0.247780 Jul 27 16:43:17.303594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 465/912] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:43:17 2022] DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/98e39ebe-f232-4141-a5d4-f8988a4b64ff => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:19.554580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:19.555864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:19.563475 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:19.564301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:19.565329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:19.565966 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:19.603899 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a41a225b-402a-43ec-a0b1-448454f3d27a tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/11f546b9-2bae-4cbd-a500-6fee02c13a54" status: 200 len: 194 microversion: 2.1 time: 0.053668 Jul 27 16:43:19.607371 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 448/913] 10.222.0.74 () {58 vars in 1413 bytes} [Wed Jul 27 16:43:19 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/11f546b9-2bae-4cbd-a500-6fee02c13a54 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:19.628070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:19.628726 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:19.646937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:19.647380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:19.648471 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:19.651498 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:19.759851 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'services' on Instance uuid 135ef04d-6996-46ef-90a6-39ad9504292b {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:43:19.866097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d34b65d9-19f5-4789-99ba-8b39b80a80c2 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/11f546b9-2bae-4cbd-a500-6fee02c13a54" status: 202 len: 0 microversion: 2.1 time: 0.245410 Jul 27 16:43:19.866759 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 466/914] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:43:19 2022] DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments/11f546b9-2bae-4cbd-a500-6fee02c13a54 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:21.061773 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:21.064146 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:21.070909 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.071365 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.072146 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.072588 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.075239 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:21.106406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a273c0bc-c55d-426f-babc-c97bbfbd52e4 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048613 Jul 27 16:43:21.107842 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 449/915] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:43:21 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:43:21.235670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:21.237934 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:21.244170 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.244619 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.245423 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.245856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.276600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-aef5047e-8a90-4b61-b522-93a1ca2ec5e1 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045687 Jul 27 16:43:21.277189 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 467/916] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:43:21 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 16:43:21.345652 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:21.346352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:21.352600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.353095 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.353867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.354462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.383836 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:43:21.474647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4d03760f-e3ac-4d77-86e4-ba67f69456ec tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 204 len: 0 microversion: 2.1 time: 0.132620 Jul 27 16:43:21.476363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 450/917] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:43:21 2022] DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:43:21.485340 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:21.486678 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:21.494950 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.495529 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.496449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:21.497777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:21.699159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:21.711864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-cfd3d67f-d46f-4f1b-9cce-2034c1b92643 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1669 microversion: 2.1 time: 0.231345 Jul 27 16:43:21.713533 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 468/918] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:21 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:22.735581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:22.737026 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:22.750820 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:22.753195 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:22.755213 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:22.756699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:23.078613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:23.090404 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cb84d60e-c538-4a7f-b745-5fbaacdbb478 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1669 microversion: 2.1 time: 0.359493 Jul 27 16:43:23.099722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 451/919] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:22 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:24.120484 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:24.121246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:24.134476 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:24.139144 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:24.145610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:24.160030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:24.365018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:24.379655 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-05371d06-64bf-401e-a536-72ff9b86691f tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1602 microversion: 2.1 time: 0.258329 Jul 27 16:43:24.392932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 469/920] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:24 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1602 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:24.959819 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-ad72b3e8-1bb4-4e6f-b9aa-438b89085be2 req-1f0f837d-4fb6-4bb5-bee5-756f57c111a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135ef04d-6996-46ef-90a6-39ad9504292b", "name": "network-vif-deleted", "tag": "f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:24.986574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ad72b3e8-1bb4-4e6f-b9aa-438b89085be2 req-1f0f837d-4fb6-4bb5-bee5-756f57c111a2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:24.987615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-ad72b3e8-1bb4-4e6f-b9aa-438b89085be2 req-1f0f837d-4fb6-4bb5-bee5-756f57c111a2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:25.030584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-ad72b3e8-1bb4-4e6f-b9aa-438b89085be2 req-1f0f837d-4fb6-4bb5-bee5-756f57c111a2 service nova] Creating event network-vif-deleted:f49ee0a8-6ac0-4055-8fdf-5d8650d0d16c for instance 135ef04d-6996-46ef-90a6-39ad9504292b on hv-cinder-84969 Jul 27 16:43:25.052196 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-ad72b3e8-1bb4-4e6f-b9aa-438b89085be2 req-1f0f837d-4fb6-4bb5-bee5-756f57c111a2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097822 Jul 27 16:43:25.065149 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 452/921] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:25.407675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:25.409211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:25.423741 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:25.426088 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:25.430559 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:25.431417 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:25.525209 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:25.525667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:25.526116 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lazy-loading 'fault' on Instance uuid 135ef04d-6996-46ef-90a6-39ad9504292b {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:43:25.606720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0bd78165c94d9e9750fe4af4f7d375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ddf8711f2f4be88304f967149c3a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:25.618748 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f8df4413-6454-4999-b855-92f0a0287cf5 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 200 len: 1325 microversion: 2.1 time: 0.216203 Jul 27 16:43:25.619930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 470/922] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:25 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:26.641384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:26.643774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:26.654287 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:26.656028 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:26.656694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:26.657216 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:26.709612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] HTTP exception thrown: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Request method failure captured: Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b HTTP/1.1 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wl0PGRD37_-f9N5aZjKDNa6bxObvG2n6FpXKwzX_uto8dtaAksJjEc1-ixKBPChc215xKX1ZvysWsiA2G8rcScZO3MivynuBU4Ec5CKlNnZcPvOFk6L_QM68E_DRo61PJvJxuV_G1datS-5FkFg0Xq57-7zBYL00HZkaykgp5FzS74 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:26.715317 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 7a0bd78165c94d9e9750fe4af4f7d375 Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:26.717070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '135ef04d-6996-46ef-90a6-39ad9504292b'} Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:26.718444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:26.720074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:26.721796 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Returning 404 to user: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:26.721796 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2b7b98d7-dff2-4472-a489-b14c25cc7edc tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 404 len: 111 microversion: 2.1 time: 0.084382 Jul 27 16:43:26.725180 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 471/923] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:26 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:26.736256 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b8b43f88-f074-4cdf-9455-64d17bda5211 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '.version_select at 0x7ff570ce2040>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:26.772563 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b8b43f88-f074-4cdf-9455-64d17bda5211 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52880838" status: 202 len: 0 microversion: 2.1 time: 0.045504 Jul 27 16:43:26.777720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 472/924] 10.222.0.74 () {58 vars in 1215 bytes} [Wed Jul 27 16:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52880838 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:26.947380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a88b8072-8049-4856-84b7-0a978c95117b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Action: 'create', calling method: .version_select at 0x7ff56c420b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-84197481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBosO+7sUkKYOHJukPc2Kx7UfUtVvIFOFHI2TLmPk9evjpK0+UzOWTC7r8q8omBhW+LcSCHwjTdPpdt3sDRUGElcAq2d4BK3EczImac+2tSHaR1aU0cTF9DJSqT8jkyMw=="}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:26.966843 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-a88b8072-8049-4856-84b7-0a978c95117b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:43:26.971573 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-a88b8072-8049-4856-84b7-0a978c95117b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for user f965c9163ebf41a9866af7389feaf17c and project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'key_pairs'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:43:27.013270 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a88b8072-8049-4856-84b7-0a978c95117b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.489060 Jul 27 16:43:27.014552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 453/925] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:43:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:27.093809 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:27.096518 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:27.112953 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:27.113662 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:27.114612 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:27.115130 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:27.183712 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c434debb-2d07-499d-8bf2-93038bc41036 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.095264 Jul 27 16:43:27.185108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 473/926] 10.222.0.74 () {60 vars in 1343 bytes} [Wed Jul 27 16:43:27 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:27.267230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:27.268113 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:27.275278 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:27.275961 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:27.276965 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:27.277587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:27.306501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:43:27.478283 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-03f68388-71ea-46a9-8439-183cb6e9cf19 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 204 len: 0 microversion: 2.20 time: 0.210393 Jul 27 16:43:27.481905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 454/927] 10.222.0.74 () {60 vars in 1280 bytes} [Wed Jul 27 16:43:27 2022] DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 16:43:27.496070 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:27.499133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:27.508722 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:27.509906 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:27.512048 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:27.513540 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:27.756536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:27.775146 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:27.778911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:27.780539 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-32e8b85a-1af6-4790-b260-ffafb2c2ed3f tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.294325 Jul 27 16:43:27.781648 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 474/928] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:43:27 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:43:28.810403 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:28.812328 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:28.820104 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:28.820653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:28.821581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:28.822488 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:29.142848 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:29.156755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:29.158363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:29.159564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5f79ed1e-a99a-49c8-8564-5e9bb13e8e61 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1723 microversion: 2.20 time: 0.355592 Jul 27 16:43:29.168438 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 455/929] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:43:28 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:43:30.186685 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:30.187291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:30.203486 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.204227 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.205221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.208085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.338177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:30.339344 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:30.356770 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.362749 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.363600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.364056 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.382139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] HTTP exception thrown: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Request method failure captured: Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b HTTP/1.1 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl0PGRD37_-f9N5aZjKDNa6bxObvG2n6FpXKwzX_uto8dtaAksJjEc1-ixKBPChc215xKX1ZvysWsiA2G8rcScZO3MivynuBU4Ec5CKlNnZcPvOFk6L_QM68E_DRo61PJvJxuV_G1datS-5FkFg0Xq57-7zBYL00HZkaykgp5FzS74 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:30.384351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 7a0bd78165c94d9e9750fe4af4f7d375 Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.385822 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '135ef04d-6996-46ef-90a6-39ad9504292b'} Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:30.387660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.389187 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.392250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Returning 404 to user: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:30.393642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f1c01855-bc1d-4c30-a76a-ccfed6a14c63 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 404 len: 111 microversion: 2.1 time: 0.061245 Jul 27 16:43:30.406757 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 456/930] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:43:30 2022] DELETE /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:30.417517 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:30.418555 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: 135ef04d-6996-46ef-90a6-39ad9504292b] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:30.428599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.429358 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.430380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.431052 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.447613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] HTTP exception thrown: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Request method failure captured: Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b HTTP/1.1 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl0PGRD37_-f9N5aZjKDNa6bxObvG2n6FpXKwzX_uto8dtaAksJjEc1-ixKBPChc215xKX1ZvysWsiA2G8rcScZO3MivynuBU4Ec5CKlNnZcPvOFk6L_QM68E_DRo61PJvJxuV_G1datS-5FkFg0Xq57-7zBYL00HZkaykgp5FzS74 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:30.449675 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 7a0bd78165c94d9e9750fe4af4f7d375 Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.451419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '135ef04d-6996-46ef-90a6-39ad9504292b'} Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:30.452154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. Jul 27 16:43:30.453578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:30.454653 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:30.456095 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Returning 404 to user: Instance 135ef04d-6996-46ef-90a6-39ad9504292b could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:30.457443 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d20e0fcc-2882-4425-93f5-508120eb57fa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b" status: 404 len: 111 microversion: 2.1 time: 0.043925 Jul 27 16:43:30.458199 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 457/931] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:30 2022] GET /compute/v2.1/servers/135ef04d-6996-46ef-90a6-39ad9504292b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:30.464356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:30.469223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb7775bae64374b11462a53853e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d570044769a44d9b18c905284cd9947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:30.470605 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e45d6502-98a6-40f9-a9a5-523b2deda430 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 200 len: 1656 microversion: 2.20 time: 0.288129 Jul 27 16:43:30.471196 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 475/932] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:43:30 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 1656 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 16:43:30.520824 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-0c74f4e0-192d-4077-a579-982c731e1984 req-2ea2850e-063e-4e81-85a6-62b99fef7229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1640a-1831-422b-b041-ca09c22cfec3", "name": "network-vif-deleted", "tag": "a5e4d1c9-23ec-43b6-abfb-7de8126e7421"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:30.561698 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0c74f4e0-192d-4077-a579-982c731e1984 req-2ea2850e-063e-4e81-85a6-62b99fef7229 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:30.562337 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0c74f4e0-192d-4077-a579-982c731e1984 req-2ea2850e-063e-4e81-85a6-62b99fef7229 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:30.584738 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-0c74f4e0-192d-4077-a579-982c731e1984 req-2ea2850e-063e-4e81-85a6-62b99fef7229 service nova] Creating event network-vif-deleted:a5e4d1c9-23ec-43b6-abfb-7de8126e7421 for instance dac1640a-1831-422b-b041-ca09c22cfec3 on hv-cinder-84969 Jul 27 16:43:30.601439 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-0c74f4e0-192d-4077-a579-982c731e1984 req-2ea2850e-063e-4e81-85a6-62b99fef7229 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084693 Jul 27 16:43:30.602852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 458/933] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:31.497838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:31.498477 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:31.501165 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:31.508906 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:31.509376 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:31.510384 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:31.510820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:31.525995 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] HTTP exception thrown: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Request method failure captured: Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 HTTP/1.1 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlxBB8KOIwfjuszefTeyvpbCGgYOniPzhWRngurJkWHCR0yyRVwknfMhYrD8j2yv7hzsHT5ovAQGGLvRi0Jfb62hV2e4oRf5KYOLy_KGuuS57lCFibhy0DmNmLWPwHWBahQWbHuH_oCsArsNvJMAUTRYQEJztP27ouDB1q6UBit9zw Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:31.527536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d570044769a44d9b18c905284cd9947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d570044769a44d9b18c905284cd9947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 22bb7775bae64374b11462a53853e54f Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:31.529586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'dac1640a-1831-422b-b041-ca09c22cfec3'} Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:31.530367 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:31.531568 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.532667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Returning 404 to user: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:31.532667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2a2873ba-c110-4154-898c-f689ac98a445 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 404 len: 111 microversion: 2.20 time: 0.036178 Jul 27 16:43:31.532667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 476/934] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:43:31 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:43:31.539547 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-12c28bd0-4cb9-4d82-b2e9-626cbe812bcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '.version_select at 0x7ff56c320160>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:31.559515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-12c28bd0-4cb9-4d82-b2e9-626cbe812bcb tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616751187" status: 204 len: 0 microversion: 2.20 time: 0.024621 Jul 27 16:43:31.560086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 459/935] 10.222.0.74 () {60 vars in 1259 bytes} [Wed Jul 27 16:43:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616751187 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 16:43:31.690522 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:31.691017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:31.697974 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:31.698469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:31.699274 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:31.699794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:31.729084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] HTTP exception thrown: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Request method failure captured: Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 HTTP/1.1 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wl0PGRD37_-f9N5aZjKDNa6bxObvG2n6FpXKwzX_uto8dtaAksJjEc1-ixKBPChc215xKX1ZvysWsiA2G8rcScZO3MivynuBU4Ec5CKlNnZcPvOFk6L_QM68E_DRo61PJvJxuV_G1datS-5FkFg0Xq57-7zBYL00HZkaykgp5FzS74 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:31.730680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 7a0bd78165c94d9e9750fe4af4f7d375 Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.732661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'b0065d67-39b9-4506-a9c5-e3669abc73f3'} Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:31.733445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.735914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.738752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Returning 404 to user: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:31.738752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8130ff74-3a27-443a-88ba-65465b0f1756 tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 404 len: 111 microversion: 2.1 time: 0.046819 Jul 27 16:43:31.738752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 477/936] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:43:31 2022] DELETE /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:31.742595 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:31.743347 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] [instance: b0065d67-39b9-4506-a9c5-e3669abc73f3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:31.757092 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:31.757658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:31.759676 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:31.760221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:31.777892 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] HTTP exception thrown: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Request method failure captured: Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 HTTP/1.1 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wl0PGRD37_-f9N5aZjKDNa6bxObvG2n6FpXKwzX_uto8dtaAksJjEc1-ixKBPChc215xKX1ZvysWsiA2G8rcScZO3MivynuBU4Ec5CKlNnZcPvOFk6L_QM68E_DRo61PJvJxuV_G1datS-5FkFg0Xq57-7zBYL00HZkaykgp5FzS74 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:31.780785 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89ddf8711f2f4be88304f967149c3a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 89ddf8711f2f4be88304f967149c3a50 Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-368816485 Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 7a0bd78165c94d9e9750fe4af4f7d375 Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeTestJSON-368816485-project Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.782197 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'b0065d67-39b9-4506-a9c5-e3669abc73f3'} Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:31.783310 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. Jul 27 16:43:31.784602 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:31.785715 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] Returning 404 to user: Instance b0065d67-39b9-4506-a9c5-e3669abc73f3 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:31.785715 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f4fd2156-5f8b-4282-bdff-ed588cc6daaa tempest-AttachVolumeTestJSON-368816485 tempest-AttachVolumeTestJSON-368816485-project] 10.222.0.74 "GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3" status: 404 len: 111 microversion: 2.1 time: 0.043496 Jul 27 16:43:31.786961 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 460/937] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:31 2022] GET /compute/v2.1/servers/b0065d67-39b9-4506-a9c5-e3669abc73f3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:33.769723 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:33.770225 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:33.777186 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:33.777653 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:33.779241 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:33.779856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:33.796755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] HTTP exception thrown: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Request method failure captured: Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 HTTP/1.1 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlxBB8KOIwfjuszefTeyvpbCGgYOniPzhWRngurJkWHCR0yyRVwknfMhYrD8j2yv7hzsHT5ovAQGGLvRi0Jfb62hV2e4oRf5KYOLy_KGuuS57lCFibhy0DmNmLWPwHWBahQWbHuH_oCsArsNvJMAUTRYQEJztP27ouDB1q6UBit9zw Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:33.798364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d570044769a44d9b18c905284cd9947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d570044769a44d9b18c905284cd9947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 22bb7775bae64374b11462a53853e54f Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.800061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'dac1640a-1831-422b-b041-ca09c22cfec3'} Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:33.800957 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.802415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.804606 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Returning 404 to user: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:33.805826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-18f22d6a-4c91-4948-85eb-a8c8ccc20897 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 404 len: 111 microversion: 2.20 time: 0.041222 Jul 27 16:43:33.806932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 478/938] 10.222.0.74 () {60 vars in 1280 bytes} [Wed Jul 27 16:43:33 2022] DELETE /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:43:33.816964 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:33.818948 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: dac1640a-1831-422b-b041-ca09c22cfec3] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:33.826513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:33.827325 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:33.828655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:33.829352 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:33.857381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] HTTP exception thrown: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Request method failure captured: Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 HTTP/1.1 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlxBB8KOIwfjuszefTeyvpbCGgYOniPzhWRngurJkWHCR0yyRVwknfMhYrD8j2yv7hzsHT5ovAQGGLvRi0Jfb62hV2e4oRf5KYOLy_KGuuS57lCFibhy0DmNmLWPwHWBahQWbHuH_oCsArsNvJMAUTRYQEJztP27ouDB1q6UBit9zw Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:33.859435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d570044769a44d9b18c905284cd9947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d570044769a44d9b18c905284cd9947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 22bb7775bae64374b11462a53853e54f Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.861077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'dac1640a-1831-422b-b041-ca09c22cfec3'} Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:33.862063 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. Jul 27 16:43:33.863596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:33.865925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Returning 404 to user: Instance dac1640a-1831-422b-b041-ca09c22cfec3 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:33.867261 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4cb52752-5701-4dfa-a9be-af79037363cd tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3" status: 404 len: 111 microversion: 2.20 time: 0.055931 Jul 27 16:43:33.868313 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 461/939] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:43:33 2022] GET /compute/v2.1/servers/dac1640a-1831-422b-b041-ca09c22cfec3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 16:43:35.043729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:35.045181 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:35.064175 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:35.065742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:35.067033 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:35.067646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:35.102108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] HTTP exception thrown: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Request method failure captured: Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 HTTP/1.1 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WlxBB8KOIwfjuszefTeyvpbCGgYOniPzhWRngurJkWHCR0yyRVwknfMhYrD8j2yv7hzsHT5ovAQGGLvRi0Jfb62hV2e4oRf5KYOLy_KGuuS57lCFibhy0DmNmLWPwHWBahQWbHuH_oCsArsNvJMAUTRYQEJztP27ouDB1q6UBit9zw Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:35.103959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d570044769a44d9b18c905284cd9947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d570044769a44d9b18c905284cd9947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 22bb7775bae64374b11462a53853e54f Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.105667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'a008e56d-969e-442a-bb08-524ee7e06084'} Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:35.106641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.108137 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.109647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Returning 404 to user: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:35.109647 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-505616e8-d2a5-4465-b9e4-5f1b85c6cfb5 tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 404 len: 111 microversion: 2.20 time: 0.066633 Jul 27 16:43:35.116472 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 479/940] 10.222.0.74 () {60 vars in 1280 bytes} [Wed Jul 27 16:43:35 2022] DELETE /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:43:35.135803 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:35.136586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] [instance: a008e56d-969e-442a-bb08-524ee7e06084] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:35.148374 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:35.150818 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:35.151301 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:35.152119 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:35.156703 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:35.180963 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] HTTP exception thrown: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Request method failure captured: Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 HTTP/1.1 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WlxBB8KOIwfjuszefTeyvpbCGgYOniPzhWRngurJkWHCR0yyRVwknfMhYrD8j2yv7hzsHT5ovAQGGLvRi0Jfb62hV2e4oRf5KYOLy_KGuuS57lCFibhy0DmNmLWPwHWBahQWbHuH_oCsArsNvJMAUTRYQEJztP27ouDB1q6UBit9zw Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:35.182992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8d570044769a44d9b18c905284cd9947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8d570044769a44d9b18c905284cd9947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8d570044769a44d9b18c905284cd9947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 8d570044769a44d9b18c905284cd9947 Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1819040368 Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 22bb7775bae64374b11462a53853e54f Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1819040368-project Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.185612 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'a008e56d-969e-442a-bb08-524ee7e06084'} Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:35.186713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. Jul 27 16:43:35.188277 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:35.189666 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] Returning 404 to user: Instance a008e56d-969e-442a-bb08-524ee7e06084 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:35.189756 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-280a6e9a-4372-4ac5-8e4d-1672996d037e tempest-AttachVolumeShelveTestJSON-1819040368 tempest-AttachVolumeShelveTestJSON-1819040368-project] 10.222.0.74 "GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084" status: 404 len: 111 microversion: 2.20 time: 0.076273 Jul 27 16:43:35.190665 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 462/941] 10.222.0.74 () {60 vars in 1277 bytes} [Wed Jul 27 16:43:35 2022] GET /compute/v2.1/servers/a008e56d-969e-442a-bb08-524ee7e06084 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:43:37.704853 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-734b4291-08e2-4376-93e3-71739d90aa7a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Action: 'create', calling method: .version_select at 0x7ff570ce21f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-933714287"}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:38.235660 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-734b4291-08e2-4376-93e3-71739d90aa7a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.821246 Jul 27 16:43:38.236570 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 480/942] 10.222.0.74 () {60 vars in 1155 bytes} [Wed Jul 27 16:43:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 16:43:38.252028 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7cc99f64-f92b-4bff-8fa1-cfa251e69235 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c476790>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:38.262017 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:38.347867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7cc99f64-f92b-4bff-8fa1-cfa251e69235 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 200 len: 344 microversion: 2.1 time: 0.103025 Jul 27 16:43:38.348433 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 463/943] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:43:38 2022] GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:39.361516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b2edb356-c03d-477c-9347-ec48124b5f8c tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c3431f0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:39.432744 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b2edb356-c03d-477c-9347-ec48124b5f8c tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 200 len: 345 microversion: 2.1 time: 0.074146 Jul 27 16:43:39.434493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 481/944] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:43:39 2022] GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:39.449397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-bbeefa75-6872-4354-9e7b-db5e2475d2e6 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Action: 'create', calling method: .version_select at 0x7ff56c4205e0>, body: {"snapshot": {"volume_id": "77e31c10-3a8e-49de-af99-b3fedc3e5386", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1229243426"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:39.678221 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-bbeefa75-6872-4354-9e7b-db5e2475d2e6 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.234823 Jul 27 16:43:39.679010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 464/945] 10.222.0.74 () {60 vars in 1162 bytes} [Wed Jul 27 16:43:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:39.690251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-788a5386-2f19-46ed-aab5-ac72c3f4091c tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff570ce24c0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:39.723617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-788a5386-2f19-46ed-aab5-ac72c3f4091c tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 200 len: 287 microversion: 2.1 time: 0.037282 Jul 27 16:43:39.724183 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 482/946] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:39 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:43:39.735549 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-faa8b855-fefb-417e-8aff-4e1a5155277b tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c4334c0>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:39.769631 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-faa8b855-fefb-417e-8aff-4e1a5155277b tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038438 Jul 27 16:43:39.770224 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 465/947] 10.222.0.74 () {58 vars in 1140 bytes} [Wed Jul 27 16:43:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:39.783483 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0dadb8ae-ced5-44ff-9f27-629e92334662 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56cc7f8b0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:39.813195 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0dadb8ae-ced5-44ff-9f27-629e92334662 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 200 len: 287 microversion: 2.1 time: 0.033368 Jul 27 16:43:39.813839 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 483/948] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:39 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:40.724484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-829305333", "imageRef": "711e3c16-421f-487b-9c68-181aac3df516", "flavorRef": "452"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:40.789387 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] validate_networks() for None {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:43:40.826136 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3c0ed212-2172-4351-a110-6053692c9832 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56ccac820>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:40.866550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3c0ed212-2172-4351-a110-6053692c9832 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 200 len: 287 microversion: 2.1 time: 0.044547 Jul 27 16:43:40.868937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 484/949] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:40 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:41.093153 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:43:41.093577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:43:41.094051 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:43:41.094460 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:43:41.094897 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:43:41.103963 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:41.104413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:41.105250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:41.105684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:41.123537 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Getting quotas for project 6ad80139b6a04b62be6629aa767024f3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:43:41.127536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Getting quotas for user 189d57780b254f90ae9120f4c31d987a and project 6ad80139b6a04b62be6629aa767024f3. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:43:41.138947 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:43:41.141878 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711e3c16-421f-487b-9c68-181aac3df516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:43:41.189722 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e4e953f9-3eee-4926-a57b-80d93917579c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469754 Jul 27 16:43:41.196188 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 466/950] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:43:41.201970 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bae53422-6add-48e4-87e8-64142d160032 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:41.202672 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bae53422-6add-48e4-87e8-64142d160032 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:41.262257 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-bae53422-6add-48e4-87e8-64142d160032 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:41.270064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bae53422-6add-48e4-87e8-64142d160032 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1214 microversion: 2.1 time: 0.072518 Jul 27 16:43:41.270615 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 485/951] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:41 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:41.881787 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cd4e031f-23b0-4182-bc6f-1b2b0f0065c7 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c487790>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:41.920935 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cd4e031f-23b0-4182-bc6f-1b2b0f0065c7 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 200 len: 287 microversion: 2.1 time: 0.044361 Jul 27 16:43:41.921500 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 467/952] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:41 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:42.290441 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:42.291049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:42.297089 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:42.297547 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:42.298413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:42.298695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:42.302584 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:42.365880 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:42.374058 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c6ff038d-f2cf-42fb-8d9b-8d5fd6a0de43 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1218 microversion: 2.1 time: 0.087371 Jul 27 16:43:42.374610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 486/953] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:42 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:42.933172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1815aa7d-a62f-424c-83f0-ef7e1e67cb22 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c336280>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:42.969555 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1815aa7d-a62f-424c-83f0-ef7e1e67cb22 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 200 len: 288 microversion: 2.1 time: 0.039997 Jul 27 16:43:42.976856 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 468/954] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:42 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:42.985443 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c12c8589-bea9-437f-b1fc-13542a6990c3 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56cbe8280>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:43.044031 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-274171055"}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:43.045000 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:43.052231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:43.052693 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:43.053880 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:43.054511 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:43.056473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c12c8589-bea9-437f-b1fc-13542a6990c3 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "DELETE /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 202 len: 0 microversion: 2.1 time: 0.075422 Jul 27 16:43:43.057178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 487/955] 10.222.0.74 () {58 vars in 1254 bytes} [Wed Jul 27 16:43:42 2022] DELETE /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:43.066634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4a3a4aa5-5b59-461e-a614-075a997b50b0 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff570caa9d0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:43.098407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4a3a4aa5-5b59-461e-a614-075a997b50b0 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 200 len: 287 microversion: 2.1 time: 0.035528 Jul 27 16:43:43.098962 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 488/956] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:43 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:43.197068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.network.security_group_api [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Removing security group df9882dd-64c8-474b-a102-775f80848ff0 from port 82adc233-9cd1-47cb-9a9f-6589c38dcd85 Jul 27 16:43:43.404411 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:43.406292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:43.413291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:43.414125 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:43.415066 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:43.415663 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:43.509404 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:43.526919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-779fb6de-744d-4db7-8608-af4854e05ef8 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1284 microversion: 2.1 time: 0.135836 Jul 27 16:43:43.527580 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 489/957] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:43 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:43.777030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2b0221c4-7ddf-4497-8422-3a17043bdc21 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/action" status: 202 len: 0 microversion: 2.1 time: 0.737650 Jul 27 16:43:43.777700 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 469/958] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:43:43 2022] POST /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/action => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:43.796599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-79108257-adc1-4117-8de3-00250b1a5a83 req-d8642f34-0aaf-49c6-bb0e-8657746e3978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:43.855463 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-79108257-adc1-4117-8de3-00250b1a5a83 req-d8642f34-0aaf-49c6-bb0e-8657746e3978 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:43.856458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-79108257-adc1-4117-8de3-00250b1a5a83 req-d8642f34-0aaf-49c6-bb0e-8657746e3978 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:43.884253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-79108257-adc1-4117-8de3-00250b1a5a83 req-d8642f34-0aaf-49c6-bb0e-8657746e3978 service nova] Creating event network-changed:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:43:43.897955 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-79108257-adc1-4117-8de3-00250b1a5a83 req-d8642f34-0aaf-49c6-bb0e-8657746e3978 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110678 Jul 27 16:43:43.901523 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 490/959] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:44.111870 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-85fc30de-d4c5-48c3-8369-d5cc624fc79a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c487040>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:44.143409 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-85fc30de-d4c5-48c3-8369-d5cc624fc79a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] HTTP exception thrown: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-85fc30de-d4c5-48c3-8369-d5cc624fc79a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Request method failure captured: Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 HTTP/1.1 Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Ws59aUy-E8kx9ASmglh6izB32EzZXyt3n7BsB-q3N9K_GfR1wDZ02HjhUqokBZagTdWsWVLpNtri4oBIzxoNU_95Uc4r1P_-wcFy61MgYdaZMJqVKuM3B8_xDw4niySbrhq0PGdYJiDH5s5HgrMgNclk3pAa9g-mIJTpdXDzoo9LLw Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:44.146772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 40e28984712b4311bf769a93b4672536 Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'f9cb6f64-4ae3-4e05-be80-2610d6de2a90'} Jul 27 16:43:44.148515 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. (HTTP 404) (Request-ID: req-b3bee581-d278-4767-a13e-d9a6f0595bd1) Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.149996 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:44.152217 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 16:43:44.153670 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. Jul 27 16:43:44.155155 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:44.170227 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-85fc30de-d4c5-48c3-8369-d5cc624fc79a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Returning 404 to user: Snapshot f9cb6f64-4ae3-4e05-be80-2610d6de2a90 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:44.171781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-85fc30de-d4c5-48c3-8369-d5cc624fc79a tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90" status: 404 len: 111 microversion: 2.1 time: 0.064526 Jul 27 16:43:44.172651 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 470/960] 10.222.0.74 () {58 vars in 1251 bytes} [Wed Jul 27 16:43:44 2022] GET /compute/v2.1/os-snapshots/f9cb6f64-4ae3-4e05-be80-2610d6de2a90 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:44.184149 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-465e1335-47c6-41c2-a3c2-2a1766bac0f4 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56cbe8af0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:44.291157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-465e1335-47c6-41c2-a3c2-2a1766bac0f4 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 202 len: 0 microversion: 2.1 time: 0.113547 Jul 27 16:43:44.293092 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 491/961] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:43:44 2022] DELETE /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 16:43:44.310925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d1308509-4ed1-4ba1-b555-319c231af6ce tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c4ee040>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:44.378884 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d1308509-4ed1-4ba1-b555-319c231af6ce tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 200 len: 344 microversion: 2.1 time: 0.079672 Jul 27 16:43:44.380004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 471/962] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:43:44 2022] GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:44.555451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:44.557742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:44.568224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:44.569398 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:44.571435 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:44.572109 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:44.717022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:44.725184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3b132a9a-a328-4040-8bc0-476f82874e9e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1272 microversion: 2.1 time: 0.177987 Jul 27 16:43:44.726269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 492/963] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:44 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:45.396710 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5cc3b784-8907-4b91-8ddd-7598bb9959f8 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56c34ea60>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:45.436867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-5cc3b784-8907-4b91-8ddd-7598bb9959f8 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] HTTP exception thrown: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5cc3b784-8907-4b91-8ddd-7598bb9959f8 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Request method failure captured: Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 HTTP/1.1 Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Ws59aUy-E8kx9ASmglh6izB32EzZXyt3n7BsB-q3N9K_GfR1wDZ02HjhUqokBZagTdWsWVLpNtri4oBIzxoNU_95Uc4r1P_-wcFy61MgYdaZMJqVKuM3B8_xDw4niySbrhq0PGdYJiDH5s5HgrMgNclk3pAa9g-mIJTpdXDzoo9LLw Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:45.440510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 40e28984712b4311bf769a93b4672536 Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '77e31c10-3a8e-49de-af99-b3fedc3e5386'} Jul 27 16:43:45.442057 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. (HTTP 404) (Request-ID: req-c63ba04e-d137-4c3b-bd1d-c26a4d872471) Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.443021 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:45.444416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 16:43:45.445613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5cc3b784-8907-4b91-8ddd-7598bb9959f8 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Returning 404 to user: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5cc3b784-8907-4b91-8ddd-7598bb9959f8 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 404 len: 109 microversion: 2.1 time: 0.051233 Jul 27 16:43:45.446759 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 472/964] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:43:45 2022] GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:45.452598 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a70274e4-2891-49a2-827a-f87e66ab5741 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56cbe8e50>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:45.513075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-a70274e4-2891-49a2-827a-f87e66ab5741 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] HTTP exception thrown: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a70274e4-2891-49a2-827a-f87e66ab5741 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Request method failure captured: Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 HTTP/1.1 Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Ws59aUy-E8kx9ASmglh6izB32EzZXyt3n7BsB-q3N9K_GfR1wDZ02HjhUqokBZagTdWsWVLpNtri4oBIzxoNU_95Uc4r1P_-wcFy61MgYdaZMJqVKuM3B8_xDw4niySbrhq0PGdYJiDH5s5HgrMgNclk3pAa9g-mIJTpdXDzoo9LLw Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:45.515767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 40e28984712b4311bf769a93b4672536 Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '77e31c10-3a8e-49de-af99-b3fedc3e5386'} Jul 27 16:43:45.517406 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. (HTTP 404) (Request-ID: req-11b88c6d-a6b7-4aba-b379-7012f7a75165) Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.518366 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 16:43:45.519887 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 16:43:45.521259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.522760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-a70274e4-2891-49a2-827a-f87e66ab5741 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Returning 404 to user: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:45.523630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:45.523728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-a70274e4-2891-49a2-827a-f87e66ab5741 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 404 len: 109 microversion: 2.1 time: 0.069036 Jul 27 16:43:45.523867 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:45.523961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 493/965] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:43:45 2022] DELETE /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:45.528614 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-af85b610-f6a3-435f-9b7e-8a7f20f15502 req-32b1a5fd-ef04-495d-9904-649e874d6989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:45.528798 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.529279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:45.530107 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.530539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:45.551493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-af85b610-f6a3-435f-9b7e-8a7f20f15502 req-32b1a5fd-ef04-495d-9904-649e874d6989 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.552588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-af85b610-f6a3-435f-9b7e-8a7f20f15502 req-32b1a5fd-ef04-495d-9904-649e874d6989 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:45.566741 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-af85b610-f6a3-435f-9b7e-8a7f20f15502 req-32b1a5fd-ef04-495d-9904-649e874d6989 service nova] Creating event network-changed:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:43:45.584595 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-af85b610-f6a3-435f-9b7e-8a7f20f15502 req-32b1a5fd-ef04-495d-9904-649e874d6989 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049943 Jul 27 16:43:45.587595 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 494/966] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:45.603247 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-78387754-fb8a-447c-a97b-948861eefe50 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Calling method '.version_select at 0x7ff56cbe8ee0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:45.658759 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-78387754-fb8a-447c-a97b-948861eefe50 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] HTTP exception thrown: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-78387754-fb8a-447c-a97b-948861eefe50 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Request method failure captured: Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 HTTP/1.1 Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Ws59aUy-E8kx9ASmglh6izB32EzZXyt3n7BsB-q3N9K_GfR1wDZ02HjhUqokBZagTdWsWVLpNtri4oBIzxoNU_95Uc4r1P_-wcFy61MgYdaZMJqVKuM3B8_xDw4niySbrhq0PGdYJiDH5s5HgrMgNclk3pAa9g-mIJTpdXDzoo9LLw Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:45.661845 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c93a0e8d8e004bd4bacc67363ac5a9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: c93a0e8d8e004bd4bacc67363ac5a9bc Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2098091275 Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 40e28984712b4311bf769a93b4672536 Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2098091275-project Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '77e31c10-3a8e-49de-af99-b3fedc3e5386'} Jul 27 16:43:45.663489 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. (HTTP 404) (Request-ID: req-1fe1eceb-18dd-4c06-924b-a690c0311b89) Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.664473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:45.666022 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 16:43:45.667536 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-78387754-fb8a-447c-a97b-948861eefe50 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] Returning 404 to user: Volume 77e31c10-3a8e-49de-af99-b3fedc3e5386 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-78387754-fb8a-447c-a97b-948861eefe50 tempest-VolumesSnapshotsTestJSON-2098091275 tempest-VolumesSnapshotsTestJSON-2098091275-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386" status: 404 len: 109 microversion: 2.1 time: 0.074497 Jul 27 16:43:45.669040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 495/967] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:43:45 2022] GET /compute/v2.1/os-volumes/77e31c10-3a8e-49de-af99-b3fedc3e5386 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:45.696311 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.objects.instance [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lazy-loading 'services' on Instance uuid 62052d5b-7135-4e70-b6a3-e14c82a6f1eb {{(pid=124235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:43:45.748942 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:45.757253 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:45.793338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.795852 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:45.796691 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.797158 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:45.883480 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-88b3dec6-1513-42f7-afe1-38ffaaa16773 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments/a6ea1f15-4943-4c2d-9c1e-2070202241a1" status: 202 len: 0 microversion: 2.1 time: 0.371693 Jul 27 16:43:45.889039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 473/968] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:43:45 2022] DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments/a6ea1f15-4943-4c2d-9c1e-2070202241a1 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:45.908872 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:45.921629 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:45.935354 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.939250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:45.940189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:45.941488 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:46.037997 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0591505d-e3b7-4093-8992-d539c9197f81 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144337 Jul 27 16:43:46.041237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 474/969] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:43:45 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:46.613209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-0284d6e9-2e83-4ace-a470-e88e7e3240c2 req-16eeb995-1e6f-41f3-8263-83d4793bc8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa0d90-1e1a-4782-ba30-d8a8910253b4", "tag": "ab69c434-3553-4b28-85ac-da460818f621"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:46.634276 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0284d6e9-2e83-4ace-a470-e88e7e3240c2 req-16eeb995-1e6f-41f3-8263-83d4793bc8b6 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:46.634953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-0284d6e9-2e83-4ace-a470-e88e7e3240c2 req-16eeb995-1e6f-41f3-8263-83d4793bc8b6 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:46.650967 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-0284d6e9-2e83-4ace-a470-e88e7e3240c2 req-16eeb995-1e6f-41f3-8263-83d4793bc8b6 service nova] Creating event network-changed:ab69c434-3553-4b28-85ac-da460818f621 for instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 on hv-cinder-84969 Jul 27 16:43:46.657289 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-0284d6e9-2e83-4ace-a470-e88e7e3240c2 req-16eeb995-1e6f-41f3-8263-83d4793bc8b6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047956 Jul 27 16:43:46.658633 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 475/970] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:43:46.900908 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:46.910959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c631df95-86d3-4797-83e2-3fef378d8e5e tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1314 microversion: 2.1 time: 1.167931 Jul 27 16:43:46.914326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 496/971] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:45 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:47.056660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:47.059634 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:47.096774 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:47.100411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:47.101650 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:47.104780 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:47.161571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d7bef6ab-4e01-4217-a2d5-032c68e27be9 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109454 Jul 27 16:43:47.162157 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 476/972] 10.222.0.74 () {58 vars in 1302 bytes} [Wed Jul 27 16:43:47 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 16:43:47.179580 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:47.180062 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:47.192789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:47.193255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:47.194027 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:47.194460 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:47.303739 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] HTTP exception thrown: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb is not attached to volume a6ea1f15-4943-4c2d-9c1e-2070202241a1 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Request method failure captured: Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments/a6ea1f15-4943-4c2d-9c1e-2070202241a1 HTTP/1.1 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wqsj3dBiTi4aAJXa8VoGwovoXQonuJ8la6MvxAZzioqgITcJ2pXuj5ayTsrMyl8pRFXm5QflrfGjy8hNvsYa4x9uQlT9mgKwTaEbXjKv4EppZOPHR_CthXLyIGEC3g6W-xTlCpRVUPGQMLU4pHqCXiXjEjiWqyLl_iFsvJye98WGEI Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 95d1afc492b44c07800f8d7288dac741 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-TestMinimumBasicScenario-145212443 Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:47.322338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/95d1afc492b44c07800f8d7288dac741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/95d1afc492b44c07800f8d7288dac741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_95d1afc492b44c07800f8d7288dac741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/95d1afc492b44c07800f8d7288dac741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-TestMinimumBasicScenario-145212443 Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 95d1afc492b44c07800f8d7288dac741 Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-TestMinimumBasicScenario-145212443 Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-TestMinimumBasicScenario-145212443-project Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 6e5020300565412f9a251e471aeb17b9 Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-TestMinimumBasicScenario-145212443-project Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:47.323983 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb is not attached to volume a6ea1f15-4943-4c2d-9c1e-2070202241a1 Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'server_id': '62052d5b-7135-4e70-b6a3-e14c82a6f1eb', 'id': 'a6ea1f15-4943-4c2d-9c1e-2070202241a1'} Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a6ea1f15-4943-4c2d-9c1e-2070202241a1. Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:47.325488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb is not attached to volume a6ea1f15-4943-4c2d-9c1e-2070202241a1 Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb is not attached to volume a6ea1f15-4943-4c2d-9c1e-2070202241a1 Jul 27 16:43:47.326901 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:47.327911 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Returning 404 to user: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb is not attached to volume a6ea1f15-4943-4c2d-9c1e-2070202241a1 {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:47.328462 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fa431731-dbf3-4503-b940-4dcf7e076b4f tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments/a6ea1f15-4943-4c2d-9c1e-2070202241a1" status: 404 len: 154 microversion: 2.1 time: 0.153571 Jul 27 16:43:47.333653 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 497/973] 10.222.0.74 () {58 vars in 1416 bytes} [Wed Jul 27 16:43:47 2022] DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb/os-volume_attachments/a6ea1f15-4943-4c2d-9c1e-2070202241a1 => generated 154 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:47.931501 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:47.932114 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:47.938589 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:47.938892 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:47.939657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:47.940092 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:48.073861 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:48.081189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-22c81da5-f36e-4ff5-a78d-f968ab2242f5 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1314 microversion: 2.1 time: 0.153461 Jul 27 16:43:48.081746 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 477/974] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:47 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:48.190373 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0ad03f92-6d20-43b4-9f97-d11f6e633f86 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Action: 'create', calling method: .version_select at 0x7ff570c86550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1070264481", "metadata": {"Type": "work"}}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0ad03f92-6d20-43b4-9f97-d11f6e633f86 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Request method failure captured: Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 122 Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WtDoeapjyXLZ5zddSeap2XBXAEiB8FlqyHO5IOaLGLkk5SUhi2qk6czPJoUEKvBzxcppztoT8lreOauZokfP4eQlTXJSi26Jy4pm7Do0PKoAvOolQOpVBzUo2C8-XUR55HY2QUv5o8L8tF6Hy7ll7so3o-uqykYXPtz54GCn88EScg Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:48.209249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 73a4e537be0d4c88bcfd55c6adb2dd38 Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1070264481", "metadata": {"Type": "work"}}} Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: Jul 27 16:43:48.210849 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1070264481', 'metadata': {'Type': 'work'}}}} Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise error Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:48.211825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 16:43:48.213396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 16:43:48.214961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 16:43:48.214961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.214961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0ad03f92-6d20-43b4-9f97-d11f6e633f86 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:48.214961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0ad03f92-6d20-43b4-9f97-d11f6e633f86 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.167760 Jul 27 16:43:48.214961 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 498/975] 10.222.0.74 () {60 vars in 1156 bytes} [Wed Jul 27 16:43:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 16:43:48.221326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-021eb4a4-e11c-4617-9466-571d73786fcf tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Action: 'create', calling method: .version_select at 0x7ff56c487790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-173260328", "metadata": {"Type": "work"}}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-021eb4a4-e11c-4617-9466-571d73786fcf tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Request method failure captured: Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 119 Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WtDoeapjyXLZ5zddSeap2XBXAEiB8FlqyHO5IOaLGLkk5SUhi2qk6czPJoUEKvBzxcppztoT8lreOauZokfP4eQlTXJSi26Jy4pm7Do0PKoAvOolQOpVBzUo2C8-XUR55HY2QUv5o8L8tF6Hy7ll7so3o-uqykYXPtz54GCn88EScg Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:48.226009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 73a4e537be0d4c88bcfd55c6adb2dd38 Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-173260328", "metadata": {"Type": "work"}}} Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: Jul 27 16:43:48.227583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-173260328', 'metadata': {'Type': 'work'}}}} Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise error Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi '0' Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:48.229264 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 16:43:48.230790 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 16:43:48.232161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 16:43:48.232161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.232161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-021eb4a4-e11c-4617-9466-571d73786fcf tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:48.232161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-021eb4a4-e11c-4617-9466-571d73786fcf tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010254 Jul 27 16:43:48.232161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 478/976] 10.222.0.74 () {60 vars in 1156 bytes} [Wed Jul 27 16:43:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 16:43:48.239530 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1814eb94-fbe7-4a80-8cf8-fde07a0bb0b7 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Action: 'create', calling method: .version_select at 0x7ff56c34e430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-977116979", "metadata": {"Type": "work"}}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1814eb94-fbe7-4a80-8cf8-fde07a0bb0b7 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Request method failure captured: Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 118 Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WtDoeapjyXLZ5zddSeap2XBXAEiB8FlqyHO5IOaLGLkk5SUhi2qk6czPJoUEKvBzxcppztoT8lreOauZokfP4eQlTXJSi26Jy4pm7Do0PKoAvOolQOpVBzUo2C8-XUR55HY2QUv5o8L8tF6Hy7ll7so3o-uqykYXPtz54GCn88EScg Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:48.243072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 73a4e537be0d4c88bcfd55c6adb2dd38 Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-977116979", "metadata": {"Type": "work"}}} Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: Jul 27 16:43:48.244629 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-977116979', 'metadata': {'Type': 'work'}}}} Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise error Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi '' Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:48.245688 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 16:43:48.247566 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 16:43:48.248697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 16:43:48.248697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.248697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1814eb94-fbe7-4a80-8cf8-fde07a0bb0b7 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:48.248697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1814eb94-fbe7-4a80-8cf8-fde07a0bb0b7 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011675 Jul 27 16:43:48.248697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 499/977] 10.222.0.74 () {60 vars in 1156 bytes} [Wed Jul 27 16:43:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 16:43:48.254914 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f1a62ce-7c3c-4721-a9f3-08fcc3083a36 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Calling method '.version_select at 0x7ff56c433d30>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:48.283047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-2f1a62ce-7c3c-4721-a9f3-08fcc3083a36 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] HTTP exception thrown: Volume tempest-invalid-333331146 could not be found. Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f1a62ce-7c3c-4721-a9f3-08fcc3083a36 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Request method failure captured: Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-333331146 HTTP/1.1 Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WtDoeapjyXLZ5zddSeap2XBXAEiB8FlqyHO5IOaLGLkk5SUhi2qk6czPJoUEKvBzxcppztoT8lreOauZokfP4eQlTXJSi26Jy4pm7Do0PKoAvOolQOpVBzUo2C8-XUR55HY2QUv5o8L8tF6Hy7ll7so3o-uqykYXPtz54GCn88EScg Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:48.285011 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 73a4e537be0d4c88bcfd55c6adb2dd38 Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Volume tempest-invalid-333331146 could not be found. Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'tempest-invalid-333331146'} Jul 27 16:43:48.286552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-333331146 could not be found. (HTTP 404) (Request-ID: req-b4808dfd-b85c-46ea-9623-f18433c3e801) Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.287497 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 16:43:48.288876 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-333331146 could not be found. Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:48.290135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-333331146 could not be found. Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-333331146 could not be found. Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2f1a62ce-7c3c-4721-a9f3-08fcc3083a36 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Returning 404 to user: Volume tempest-invalid-333331146 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2f1a62ce-7c3c-4721-a9f3-08fcc3083a36 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/tempest-invalid-333331146" status: 404 len: 98 microversion: 2.1 time: 0.035285 Jul 27 16:43:48.291859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 479/978] 10.222.0.74 () {58 vars in 1215 bytes} [Wed Jul 27 16:43:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-333331146 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 16:43:48.296426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b4ca0436-87ed-493c-ae34-f44dcdbc9e12 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004189 Jul 27 16:43:48.296918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 500/979] 10.222.0.74 () {58 vars in 1140 bytes} [Wed Jul 27 16:43:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 16:43:48.304973 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-15a445c1-7f0b-4c66-8836-b0d735a138b2 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003755 Jul 27 16:43:48.305459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 480/980] 10.222.0.74 () {58 vars in 1137 bytes} [Wed Jul 27 16:43:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 16:43:48.313736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f421b73b-3f4b-4d13-8315-b140981d5e2d tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Calling method '.version_select at 0x7ff56cbe8a60>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:48.340433 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-f421b73b-3f4b-4d13-8315-b140981d5e2d tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] HTTP exception thrown: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f421b73b-3f4b-4d13-8315-b140981d5e2d tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Request method failure captured: Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/os-volumes/11c2f44e-ae48-45ac-8302-d1c0fc20b592 HTTP/1.1 Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WtDoeapjyXLZ5zddSeap2XBXAEiB8FlqyHO5IOaLGLkk5SUhi2qk6czPJoUEKvBzxcppztoT8lreOauZokfP4eQlTXJSi26Jy4pm7Do0PKoAvOolQOpVBzUo2C8-XUR55HY2QUv5o8L8tF6Hy7ll7so3o-uqykYXPtz54GCn88EScg Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:48.342408 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 73a4e537be0d4c88bcfd55c6adb2dd38 Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '11c2f44e-ae48-45ac-8302-d1c0fc20b592'} Jul 27 16:43:48.344005 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. (HTTP 404) (Request-ID: req-3f8ff267-2693-400b-8ed0-1e22555d747a) Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.345140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 16:43:48.346772 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 16:43:48.347930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f421b73b-3f4b-4d13-8315-b140981d5e2d tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Returning 404 to user: Volume 11c2f44e-ae48-45ac-8302-d1c0fc20b592 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f421b73b-3f4b-4d13-8315-b140981d5e2d tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/11c2f44e-ae48-45ac-8302-d1c0fc20b592" status: 404 len: 109 microversion: 2.1 time: 0.033398 Jul 27 16:43:48.349363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 501/981] 10.222.0.74 () {58 vars in 1248 bytes} [Wed Jul 27 16:43:48 2022] DELETE /compute/v2.1/os-volumes/11c2f44e-ae48-45ac-8302-d1c0fc20b592 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:48.353523 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-31bc8f61-9378-402d-abb0-093a9d149373 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Calling method '.version_select at 0x7ff56c4ee280>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:48.381082 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-31bc8f61-9378-402d-abb0-093a9d149373 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] HTTP exception thrown: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-31bc8f61-9378-402d-abb0-093a9d149373 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Request method failure captured: Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/os-volumes/7f9b31b0-2133-487b-8a18-e99646fae8b5 HTTP/1.1 Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4WtDoeapjyXLZ5zddSeap2XBXAEiB8FlqyHO5IOaLGLkk5SUhi2qk6czPJoUEKvBzxcppztoT8lreOauZokfP4eQlTXJSi26Jy4pm7Do0PKoAvOolQOpVBzUo2C8-XUR55HY2QUv5o8L8tF6Hy7ll7so3o-uqykYXPtz54GCn88EScg Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:48.383043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/76552deb302841cc86b960fe1f50b2c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 76552deb302841cc86b960fe1f50b2c4 Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-VolumesNegativeTest-1113186719 Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 73a4e537be0d4c88bcfd55c6adb2dd38 Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-VolumesNegativeTest-1113186719-project Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '7f9b31b0-2133-487b-8a18-e99646fae8b5'} Jul 27 16:43:48.384619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. (HTTP 404) (Request-ID: req-b6b62458-431f-4931-8271-a138726ec273) Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.385830 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 16:43:48.387494 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 16:43:48.388805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-31bc8f61-9378-402d-abb0-093a9d149373 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] Returning 404 to user: Volume 7f9b31b0-2133-487b-8a18-e99646fae8b5 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:48.390290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-31bc8f61-9378-402d-abb0-093a9d149373 tempest-VolumesNegativeTest-1113186719 tempest-VolumesNegativeTest-1113186719-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7f9b31b0-2133-487b-8a18-e99646fae8b5" status: 404 len: 109 microversion: 2.1 time: 0.034850 Jul 27 16:43:48.392971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 481/982] 10.222.0.74 () {58 vars in 1245 bytes} [Wed Jul 27 16:43:48 2022] GET /compute/v2.1/os-volumes/7f9b31b0-2133-487b-8a18-e99646fae8b5 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:48.581353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:48.581850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:48.588679 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-616643533", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-84197481", "security_groups": [{"name": "tempest-secgroup-smoke-773411907"}], "block_device_mapping_v2": [{"uuid": "6056e1cb-b6be-492a-8d0a-a424e2b9095f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f56948a9-265f-4da0-9590-a0bad1ef68c4"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:48.589781 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:48.590262 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:48.591071 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:48.591677 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:48.623007 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:43:48.724938 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-28e248e6-2863-4fc0-a671-bd4a3665869d tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 204 len: 0 microversion: 2.1 time: 0.147954 Jul 27 16:43:48.725760 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 502/983] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:43:48 2022] DELETE /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:43:48.735628 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:48.736326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:48.743588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:48.744056 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:48.744826 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:48.745291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:48.781921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] validate_networks() for [('f56948a9-265f-4da0-9590-a0bad1ef68c4', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:43:48.997082 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:49.011318 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ffeeebc8-00f8-435c-9572-727d29fa4024 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1554 microversion: 2.1 time: 0.279987 Jul 27 16:43:49.011825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 503/984] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:48 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:49.104783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:49.105986 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:49.112362 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:49.112834 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:49.113636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:49.114954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:49.347039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:49.356084 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-151b27d7-75e0-4c52-a01f-191f88d829bb tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1314 microversion: 2.1 time: 0.256854 Jul 27 16:43:49.356871 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 504/985] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:49 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:49.451630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:43:49.452194 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:43:49.452564 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:43:49.452999 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:43:49.453440 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:43:49.462471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:49.462925 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:49.463733 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:49.464172 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:49.473163 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:49.484988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:43:49.489043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for user f965c9163ebf41a9866af7389feaf17c and project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:43:49.551881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:43:49.556500 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6056e1cb-b6be-492a-8d0a-a424e2b9095f',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:43:49.718951 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-6f2d9cba-1d61-4b38-96fe-8db9e81e3924 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.134967 Jul 27 16:43:49.719779 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 482/986] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:43:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 16:43:49.730717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1bf605d1-0ec8-4d41-abed-1e4cc2799e9b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:49.731404 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1bf605d1-0ec8-4d41-abed-1e4cc2799e9b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:49.803316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1bf605d1-0ec8-4d41-abed-1e4cc2799e9b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:49.815759 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1bf605d1-0ec8-4d41-abed-1e4cc2799e9b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1092 microversion: 2.1 time: 0.086990 Jul 27 16:43:49.817068 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 505/987] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:49 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1092 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:50.034916 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:50.035871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:50.045484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:50.046209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:50.047784 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:50.048391 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:50.290858 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:50.298809 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2c189525-c871-473d-819f-7bdf1b96e658 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1554 microversion: 2.1 time: 0.268917 Jul 27 16:43:50.299844 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 483/988] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:50 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:50.381055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:50.382565 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:50.399711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:50.401529 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:50.402737 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:50.416454 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:50.689021 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:50.697312 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6b3b09ad-1077-45ec-8c9b-c97b75a4b947 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1314 microversion: 2.1 time: 0.321480 Jul 27 16:43:50.697864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 506/989] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:50 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:50.837514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:50.838461 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:50.852559 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:50.854540 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:50.857641 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:50.859229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:51.016815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:51.026242 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-0c7135e8-8819-4ead-9dd1-21d11ed8d679 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1198 microversion: 2.1 time: 0.192878 Jul 27 16:43:51.028483 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 484/990] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:50 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1198 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:51.322224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:51.322707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:51.332219 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:51.332667 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:51.339165 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-24041056-ca84-4636-a191-cd9e9812411d req-90527f75-9a67-43ae-934d-0744a6733915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62052d5b-7135-4e70-b6a3-e14c82a6f1eb", "name": "network-vif-deleted", "tag": "82adc233-9cd1-47cb-9a9f-6589c38dcd85"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:51.346014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:51.346469 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:51.357815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-24041056-ca84-4636-a191-cd9e9812411d req-90527f75-9a67-43ae-934d-0744a6733915 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:51.358260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-24041056-ca84-4636-a191-cd9e9812411d req-90527f75-9a67-43ae-934d-0744a6733915 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:51.386851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-24041056-ca84-4636-a191-cd9e9812411d req-90527f75-9a67-43ae-934d-0744a6733915 service nova] Creating event network-vif-deleted:82adc233-9cd1-47cb-9a9f-6589c38dcd85 for instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb on hv-cinder-84969 Jul 27 16:43:51.402686 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-24041056-ca84-4636-a191-cd9e9812411d req-90527f75-9a67-43ae-934d-0744a6733915 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066983 Jul 27 16:43:51.403554 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 485/991] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:43:51.460502 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5020300565412f9a251e471aeb17b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d1afc492b44c07800f8d7288dac741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:51.473900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0b9ad37f-3381-420c-b012-700d135995ef tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 200 len: 1512 microversion: 2.1 time: 0.156547 Jul 27 16:43:51.475037 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 507/992] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:51 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:51.725233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:51.726657 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:51.749921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:51.754619 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:51.759860 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:51.760721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:51.978795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-cb9a31ef-4253-4533-8170-2a8a5378cfeb req-ed51f6d5-0428-4cf4-8806-d4297ecf0ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa0d90-1e1a-4782-ba30-d8a8910253b4", "name": "network-vif-plugged", "status": "completed", "tag": "ab69c434-3553-4b28-85ac-da460818f621"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:52.023570 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-cb9a31ef-4253-4533-8170-2a8a5378cfeb req-ed51f6d5-0428-4cf4-8806-d4297ecf0ea8 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:52.026073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-cb9a31ef-4253-4533-8170-2a8a5378cfeb req-ed51f6d5-0428-4cf4-8806-d4297ecf0ea8 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:52.048473 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-cb9a31ef-4253-4533-8170-2a8a5378cfeb req-ed51f6d5-0428-4cf4-8806-d4297ecf0ea8 service nova] Creating event network-vif-plugged:ab69c434-3553-4b28-85ac-da460818f621 for instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 on hv-cinder-84969 Jul 27 16:43:52.072193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-cb9a31ef-4253-4533-8170-2a8a5378cfeb req-ed51f6d5-0428-4cf4-8806-d4297ecf0ea8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099613 Jul 27 16:43:52.081558 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 508/993] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:52.093742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:52.094471 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:52.125364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:52.125364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:52.125364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:52.125364 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:52.178009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:52.186653 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7428daad-0a8b-4481-b976-e094f0faad6d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1314 microversion: 2.1 time: 0.471840 Jul 27 16:43:52.192492 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 486/994] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:51 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:52.472615 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:52.483753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7c2905b9-e4d0-49da-8d5a-ca0791d6c065 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.399819 Jul 27 16:43:52.485055 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 509/995] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:52 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:52.503641 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:52.504320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] [instance: 62052d5b-7135-4e70-b6a3-e14c82a6f1eb] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:52.511918 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:52.513027 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:52.513823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:52.517516 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:52.533868 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] HTTP exception thrown: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb could not be found. Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Request method failure captured: Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb HTTP/1.1 Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wqsj3dBiTi4aAJXa8VoGwovoXQonuJ8la6MvxAZzioqgITcJ2pXuj5ayTsrMyl8pRFXm5QflrfGjy8hNvsYa4x9uQlT9mgKwTaEbXjKv4EppZOPHR_CthXLyIGEC3g6W-xTlCpRVUPGQMLU4pHqCXiXjEjiWqyLl_iFsvJye98WGEI Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: 95d1afc492b44c07800f8d7288dac741 Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestMinimumBasicScenario-145212443 Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:43:52.536139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/95d1afc492b44c07800f8d7288dac741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/95d1afc492b44c07800f8d7288dac741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_95d1afc492b44c07800f8d7288dac741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/95d1afc492b44c07800f8d7288dac741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestMinimumBasicScenario-145212443 Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: 95d1afc492b44c07800f8d7288dac741 Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestMinimumBasicScenario-145212443 Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-TestMinimumBasicScenario-145212443-project Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: 6e5020300565412f9a251e471aeb17b9 Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestMinimumBasicScenario-145212443-project Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb could not be found. Jul 27 16:43:52.537654 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '62052d5b-7135-4e70-b6a3-e14c82a6f1eb'} Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb could not be found. Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:52.538527 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb could not be found. Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb could not be found. Jul 27 16:43:52.540001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:43:52.541571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Returning 404 to user: Instance 62052d5b-7135-4e70-b6a3-e14c82a6f1eb could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:52.541571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c62f9104-7fd4-4a3b-89e5-fea37018ed57 tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb" status: 404 len: 111 microversion: 2.1 time: 0.037961 Jul 27 16:43:52.541571 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 487/996] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:52 2022] GET /compute/v2.1/servers/62052d5b-7135-4e70-b6a3-e14c82a6f1eb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:43:52.546415 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-aaa5565c-e67c-4bda-b995-1deb6a4b079a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] Calling method '.version_select at 0x7ff570ce2820>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:52.566475 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-aaa5565c-e67c-4bda-b995-1deb6a4b079a tempest-TestMinimumBasicScenario-145212443 tempest-TestMinimumBasicScenario-145212443-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1869507167" status: 202 len: 0 microversion: 2.1 time: 0.023771 Jul 27 16:43:52.567355 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 510/997] 10.222.0.74 () {58 vars in 1272 bytes} [Wed Jul 27 16:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1869507167 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:43:53.129813 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-273fd72d-2233-43de-b3e9-bec294a9e86b req-cfbe20bc-2a88-4528-ab59-2cb2fdc58192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478cfc69-4fbf-4a0c-86f4-8de2d02d9283", "tag": "a559e835-d7c5-4eed-9e20-a6d0ff6dc325"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:53.148955 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-273fd72d-2233-43de-b3e9-bec294a9e86b req-cfbe20bc-2a88-4528-ab59-2cb2fdc58192 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:53.149297 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-273fd72d-2233-43de-b3e9-bec294a9e86b req-cfbe20bc-2a88-4528-ab59-2cb2fdc58192 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:53.186699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-273fd72d-2233-43de-b3e9-bec294a9e86b req-cfbe20bc-2a88-4528-ab59-2cb2fdc58192 service nova] Creating event network-changed:a559e835-d7c5-4eed-9e20-a6d0ff6dc325 for instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 on hv-cinder-84969 Jul 27 16:43:53.204689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-273fd72d-2233-43de-b3e9-bec294a9e86b req-cfbe20bc-2a88-4528-ab59-2cb2fdc58192 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079506 Jul 27 16:43:53.205754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 488/998] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:43:53.212945 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:53.213973 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:53.221145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:53.221915 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:53.222909 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:53.223544 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:53.505826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:53.506684 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:53.515001 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:53.515294 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:53.516255 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:53.517375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:53.518164 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:53.529613 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-944791d8-3728-41a5-83ff-e04d8fd2681c tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1314 microversion: 2.1 time: 0.319532 Jul 27 16:43:53.531982 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 511/999] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:53 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:53.701115 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:53.710093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5bf489cc-bc69-411b-a813-b1a27aed932a tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.208589 Jul 27 16:43:53.711055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 489/1000] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:53 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:54.555790 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:54.558157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:54.568217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:54.569599 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:54.570693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:54.571138 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:54.733023 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:54.734185 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:54.748138 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:54.749185 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:54.750162 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:54.752230 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:54.796193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:54.804176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ff840121-38b3-4774-8b5c-d4be6e9de898 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1464 microversion: 2.1 time: 0.255676 Jul 27 16:43:54.805521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 512/1001] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:54 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1464 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:54.860997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:54.862115 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:54.872639 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:54.873353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:54.874496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:54.875098 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:54.932907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:43:54.967877 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:54.973088 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:54.988305 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-73bea0df-fa2e-4c5f-8bd1-56b8754eb135 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.260415 Jul 27 16:43:54.988917 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 490/1002] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:54 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:43:55.106291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3e4f6a81-355b-4eea-bcec-b6fecbafc060 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "DELETE /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 204 len: 0 microversion: 2.1 time: 0.251197 Jul 27 16:43:55.112164 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 513/1003] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:43:54 2022] DELETE /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 16:43:55.118139 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:55.119730 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:55.126648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:55.127508 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:55.128456 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:55.129459 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:55.309436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:55.317407 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-b0aa9067-0cb1-49c1-8247-cc30ac286259 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1470 microversion: 2.1 time: 0.203831 Jul 27 16:43:55.318332 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 491/1004] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:55 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:56.012761 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:56.014401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:56.032970 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:56.033838 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:56.034517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:56.034956 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:56.309659 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:56.318836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5e45395a-aa45-4f61-a5f0-993b21c96776 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.310749 Jul 27 16:43:56.320049 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 514/1005] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:56 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:56.338833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:56.340326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:56.351930 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:56.352628 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:56.354469 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:56.354919 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:56.631578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:56.662560 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-339668c0-f208-44dc-9fa5-793dd152efd0 tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1470 microversion: 2.1 time: 0.313976 Jul 27 16:43:56.666204 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 492/1006] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:56 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:57.341053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:57.341675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:57.351192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:57.352072 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:57.356668 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:57.359279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:57.696049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:57.697026 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:57.716432 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:57.732851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:57.733299 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:57.734300 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:57.734762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:57.741622 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-dffb834d-b089-4f29-aeb3-e2486dad3e5f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.404490 Jul 27 16:43:57.753806 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 515/1007] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:57 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:57.934177 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-f914f847-6591-4083-8c27-bbc07530990f req-41ea7242-2192-4891-b8de-c55b064c6a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa0d90-1e1a-4782-ba30-d8a8910253b4", "name": "network-vif-deleted", "tag": "ab69c434-3553-4b28-85ac-da460818f621"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:43:57.956650 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f914f847-6591-4083-8c27-bbc07530990f req-41ea7242-2192-4891-b8de-c55b064c6a47 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:57.958124 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f914f847-6591-4083-8c27-bbc07530990f req-41ea7242-2192-4891-b8de-c55b064c6a47 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:57.964881 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189d57780b254f90ae9120f4c31d987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad80139b6a04b62be6629aa767024f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:57.976487 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-953aad84-eab5-4df8-b24f-ec21afe5035f tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 200 len: 1428 microversion: 2.1 time: 0.288764 Jul 27 16:43:57.977267 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 493/1008] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:57 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 1428 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:43:58.009061 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-f914f847-6591-4083-8c27-bbc07530990f req-41ea7242-2192-4891-b8de-c55b064c6a47 service nova] Creating event network-vif-deleted:ab69c434-3553-4b28-85ac-da460818f621 for instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 on hv-cinder-84969 Jul 27 16:43:58.019608 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-f914f847-6591-4083-8c27-bbc07530990f req-41ea7242-2192-4891-b8de-c55b064c6a47 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090037 Jul 27 16:43:58.020728 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 516/1009] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:43:58.764427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:58.766086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:58.777420 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:58.781036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:58.783377 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:58.785956 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:59.006347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:43:59.007039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] [instance: 81aa0d90-1e1a-4782-ba30-d8a8910253b4] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:43:59.017594 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:59.023614 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:59.024675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:43:59.025407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:43:59.050907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] HTTP exception thrown: Instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 could not be found. Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Request method failure captured: Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 HTTP/1.1 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Ws68WAK0mTQsK_8pV0SwkNFJsWo0edZ4dYZ5szfP0lyTMwdByax3C2VEdTgkNQAueC-LQaoVSy-336nJyGrhH5wcRZRd-YdlKsrR4pOUevUvrQLd1iF8JLoSflMHqhZg-5ikJYoO8T45ml_5r8RtN6zm3Y1mgi_PbL6EUfmyz7Krr0 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 6ad80139b6a04b62be6629aa767024f3 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-VolumesNegativeTest-104342414 Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:43:59.052799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6ad80139b6a04b62be6629aa767024f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6ad80139b6a04b62be6629aa767024f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_6ad80139b6a04b62be6629aa767024f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/6ad80139b6a04b62be6629aa767024f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-VolumesNegativeTest-104342414 Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 6ad80139b6a04b62be6629aa767024f3 Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-VolumesNegativeTest-104342414 Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-VolumesNegativeTest-104342414-project Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: 189d57780b254f90ae9120f4c31d987a Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-VolumesNegativeTest-104342414-project Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 could not be found. Jul 27 16:43:59.054670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '81aa0d90-1e1a-4782-ba30-d8a8910253b4'} Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 could not be found. Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:43:59.055524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 could not be found. Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 could not be found. Jul 27 16:43:59.057064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:43:59.060334 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] Returning 404 to user: Instance 81aa0d90-1e1a-4782-ba30-d8a8910253b4 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:43:59.061319 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-0b77059e-9954-443d-a311-c84ed5989e4d tempest-VolumesNegativeTest-104342414 tempest-VolumesNegativeTest-104342414-project] 10.222.0.74 "GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4" status: 404 len: 111 microversion: 2.1 time: 0.059235 Jul 27 16:43:59.070610 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 517/1010] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:59 2022] GET /compute/v2.1/servers/81aa0d90-1e1a-4782-ba30-d8a8910253b4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 16:43:59.099047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:43:59.109982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ed1e831e-6a1b-445f-a2ef-16c4542a8880 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.349831 Jul 27 16:43:59.112004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 494/1011] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:43:58 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:00.132481 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:00.133684 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:00.138159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=4 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:00.143255 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:00.144654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:00.146157 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:00.146775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:00.384374 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:00.397292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-013e31cf-15a1-4b4b-964d-df9f0ef297ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.268319 Jul 27 16:44:00.425606 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 518/1012] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:00 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:01.433226 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:01.434630 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:01.438059 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=4 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:01.438793 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=12 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:01.450927 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:01.453794 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:01.455980 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:01.457883 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:01.653586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:01.663926 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d3530dce-613e-4fa1-bb51-d17cbbd82236 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.234573 Jul 27 16:44:01.664513 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 495/1013] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:01 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:02.684381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:02.685734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:02.688421 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:02.695755 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:02.696596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:02.697596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:02.698281 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:02.902267 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:02.942732 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-de49dfec-c685-400e-8177-f34aeca5469b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.262361 Jul 27 16:44:02.944457 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 519/1014] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:02 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:03.963648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:03.964235 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:03.972080 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:03.972845 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:03.973840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:03.974731 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:04.129491 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:04.141906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-e96ae294-6372-4f85-9d6d-5706229f7df0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.181066 Jul 27 16:44:04.156323 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 496/1015] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:03 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:44:05.173300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:05.173932 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:05.189997 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:05.190449 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:05.191235 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:05.192046 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:05.393965 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:05.403703 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-308d888d-f1e0-4a79-9b1b-9872595b017b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.243925 Jul 27 16:44:05.404278 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 520/1016] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:05 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:05.924316 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-7ff65a5f-4bdd-45d9-8419-703158728487 req-60034c0c-3a61-4aee-8a92-d36a7be30f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478cfc69-4fbf-4a0c-86f4-8de2d02d9283", "name": "network-vif-plugged", "status": "completed", "tag": "a559e835-d7c5-4eed-9e20-a6d0ff6dc325"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:44:05.934713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7ff65a5f-4bdd-45d9-8419-703158728487 req-60034c0c-3a61-4aee-8a92-d36a7be30f98 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:05.935186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7ff65a5f-4bdd-45d9-8419-703158728487 req-60034c0c-3a61-4aee-8a92-d36a7be30f98 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:05.948660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-7ff65a5f-4bdd-45d9-8419-703158728487 req-60034c0c-3a61-4aee-8a92-d36a7be30f98 service nova] Creating event network-vif-plugged:a559e835-d7c5-4eed-9e20-a6d0ff6dc325 for instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 on hv-cinder-84969 Jul 27 16:44:05.954096 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-7ff65a5f-4bdd-45d9-8419-703158728487 req-60034c0c-3a61-4aee-8a92-d36a7be30f98 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Jul 27 16:44:05.954948 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 497/1017] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:44:06.423872 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:06.424652 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:06.431184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:06.431638 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:06.432616 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:06.433151 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:06.589493 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:06.598877 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-64224009-326d-49cc-9114-15253f9114b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1263 microversion: 2.1 time: 0.178682 Jul 27 16:44:06.599521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 521/1018] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:06 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:07.620587 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:07.621343 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:07.627636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:07.628379 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:07.628962 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:07.629393 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:07.791596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:07.805328 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-25acc53a-f059-4a4a-a595-46fac7904517 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1451 microversion: 2.1 time: 0.189142 Jul 27 16:44:07.805921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 498/1019] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:07 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1451 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:07.826546 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:44:07.827156 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:44:07.834734 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:07.835184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:07.835954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:07.836692 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:07.974919 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:44:07.985447 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1814e163-0ea2-48d4-8816-750c234d1fa2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1451 microversion: 2.1 time: 0.163158 Jul 27 16:44:07.997500 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 522/1020] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:44:07 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:44:09.767093 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-62f23554-e410-4bc5-be37-93e0fdef4f34 req-6973036f-e8f5-4721-af51-bdcd1102a0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478cfc69-4fbf-4a0c-86f4-8de2d02d9283", "tag": "a559e835-d7c5-4eed-9e20-a6d0ff6dc325"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:44:09.772724 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:09.779349 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-62f23554-e410-4bc5-be37-93e0fdef4f34 req-6973036f-e8f5-4721-af51-bdcd1102a0a5 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:44:09.779788 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-62f23554-e410-4bc5-be37-93e0fdef4f34 req-6973036f-e8f5-4721-af51-bdcd1102a0a5 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:44:09.790888 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-62f23554-e410-4bc5-be37-93e0fdef4f34 req-6973036f-e8f5-4721-af51-bdcd1102a0a5 service nova] Creating event network-changed:a559e835-d7c5-4eed-9e20-a6d0ff6dc325 for instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 on hv-cinder-84969 Jul 27 16:44:09.795792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-62f23554-e410-4bc5-be37-93e0fdef4f34 req-6973036f-e8f5-4721-af51-bdcd1102a0a5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Jul 27 16:44:09.796815 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 499/1021] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:45:03.197843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=7 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:03.199591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:03.394474 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f9ea2e01-e0e9-4242-9cbd-87c3c34011df tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Action: 'create', calling method: .version_select at 0x7ff56ccac5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1575939626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx8oy3Q1CIlrY5ZXfyFDrAagLU62WvW4Je6Un+H8gHkWahvOI5afWZhMk/Oub3B6QpbOyAkL97ng3va1MLJARWCPBJ/Gd/TtagKcecp6XCzgk3Rjew8p6vvHhuLnIqzYw=="}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:45:03.415753 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-f9ea2e01-e0e9-4242-9cbd-87c3c34011df tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Getting quotas for project 51a4d6fb95404988996ef7680ac1829e. Resources: {'key_pairs'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:45:03.420298 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.quota [None req-f9ea2e01-e0e9-4242-9cbd-87c3c34011df tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Getting quotas for user a5cc5606ede347b3894855fed8f49fb8 and project 51a4d6fb95404988996ef7680ac1829e. Resources: {'key_pairs'} {{(pid=124236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:45:03.442558 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f9ea2e01-e0e9-4242-9cbd-87c3c34011df tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.249589 Jul 27 16:45:03.443142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 523/1022] 10.222.0.74 () {60 vars in 1159 bytes} [Wed Jul 27 16:45:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:45:18.521565 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=83 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:18.522336 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:18.526599 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-513064445", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1575939626", "security_groups": [{"name": "tempest-secgroup-smoke-157365530"}], "networks": [{"uuid": "39b61bda-1ea9-402f-810a-2514b86ac30d"}], "block_device_mapping_v2": [{"uuid": "62beab4f-2b12-4b2b-b223-3b88fb41476c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:45:18.637201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] validate_networks() for [('39b61bda-1ea9-402f-810a-2514b86ac30d', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:45:19.002394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:45:19.002814 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:45:19.003286 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:45:19.003690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:45:19.004255 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:45:19.013802 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:19.014250 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:19.015049 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:19.015484 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:19.031754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Getting quotas for project 51a4d6fb95404988996ef7680ac1829e. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:45:19.036280 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Getting quotas for user a5cc5606ede347b3894855fed8f49fb8 and project 51a4d6fb95404988996ef7680ac1829e. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:45:19.092290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:45:19.094485 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62beab4f-2b12-4b2b-b223-3b88fb41476c',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:45:19.219781 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-90b8c185-4377-4a04-9955-24653e9c539a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700093 Jul 27 16:45:19.220410 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 500/1023] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:45:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:45:19.228859 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=4 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:19.229804 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:19.234731 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e2e1765b-3d03-494d-9ee1-5f0c8d4dbbd5 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:19.235393 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e2e1765b-3d03-494d-9ee1-5f0c8d4dbbd5 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:19.295924 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e2e1765b-3d03-494d-9ee1-5f0c8d4dbbd5 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:19.302616 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e2e1765b-3d03-494d-9ee1-5f0c8d4dbbd5 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1088 microversion: 2.1 time: 0.075179 Jul 27 16:45:19.303181 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 524/1024] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:19 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:20.323988 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:20.324689 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:20.331608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:20.332055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:20.332826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:20.333291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:20.395054 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:20.403017 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d7e79a01-cfff-4f34-9305-be53a280adcb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1204 microversion: 2.1 time: 0.082842 Jul 27 16:45:20.403576 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 501/1025] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:20 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:21.424711 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:21.425318 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:21.432443 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:21.432916 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:21.434333 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:21.434775 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:21.470143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-6d1e038b-f0a9-4df5-bd42-8c7b20bea8f6 req-b240384e-19cd-49b7-b028-f16fe00bc0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:45:21.487066 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6d1e038b-f0a9-4df5-bd42-8c7b20bea8f6 req-b240384e-19cd-49b7-b028-f16fe00bc0e9 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:21.487755 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-6d1e038b-f0a9-4df5-bd42-8c7b20bea8f6 req-b240384e-19cd-49b7-b028-f16fe00bc0e9 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:21.502838 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-6d1e038b-f0a9-4df5-bd42-8c7b20bea8f6 req-b240384e-19cd-49b7-b028-f16fe00bc0e9 service nova] Creating event network-changed:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:45:21.509380 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-6d1e038b-f0a9-4df5-bd42-8c7b20bea8f6 req-b240384e-19cd-49b7-b028-f16fe00bc0e9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043739 Jul 27 16:45:21.511186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 502/1026] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:45:21.584386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:21.592852 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-13c67435-d43b-4537-a20e-7a84249ffb5a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.172268 Jul 27 16:45:21.593636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 525/1027] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:21 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:45:22.615729 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:22.616425 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:22.623103 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:22.623552 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:22.624309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:22.624743 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:22.757777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:22.766256 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8f7823a2-bbba-4778-bf00-10dc61b9301c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.155161 Jul 27 16:45:22.766833 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 503/1028] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:22 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:23.790058 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:23.790679 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:23.797789 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:23.798260 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:23.799012 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:23.799466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:23.927913 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:23.935323 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6254f701-5ea8-4335-83d5-30c216aab1eb tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.149142 Jul 27 16:45:23.935879 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 526/1029] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:23 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:24.956205 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:24.956748 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:24.963218 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:24.963664 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:24.964425 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:24.964859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:25.099350 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:25.107210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c0af12a0-615f-4be5-956d-c01781c9ff30 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.154971 Jul 27 16:45:25.107754 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 504/1030] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:24 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:26.127752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:26.128365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:26.134867 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:26.135313 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:26.136069 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:26.136504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:26.266301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:26.273774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-d226b011-83fa-4746-822e-9046866da2ea tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.149889 Jul 27 16:45:26.274331 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 527/1031] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:26 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:27.296034 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:27.296655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:27.303436 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:27.303890 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:27.304658 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:27.305122 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:27.433320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:27.440713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-56197c51-3a14-4066-b955-32ffedf8bbff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.149124 Jul 27 16:45:27.441312 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 505/1032] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:27 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:28.461713 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:28.462338 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:28.468833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:28.469311 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:28.470080 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:28.470516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:28.604363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:28.611742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-3077c2f6-7c8b-48e3-afab-164f502f5eca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.153936 Jul 27 16:45:28.612302 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 528/1033] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:28 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:29.632207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:29.632819 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:29.635234 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:29.635892 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:29.642828 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:29.643275 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:29.644038 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:29.644476 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:29.772528 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:29.780608 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c5245e69-ee5c-45c2-9b49-2a8b50557541 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.152430 Jul 27 16:45:29.781205 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 506/1034] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:29 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:30.177102 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-f1be9590-32f2-4f87-88e5-3bc7a4eb02e4 req-8737ec85-b4e2-49fd-b34a-a4491ec44bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "name": "network-vif-plugged", "status": "completed", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:45:30.182436 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:30.189703 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f1be9590-32f2-4f87-88e5-3bc7a4eb02e4 req-8737ec85-b4e2-49fd-b34a-a4491ec44bb2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:30.190145 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-f1be9590-32f2-4f87-88e5-3bc7a4eb02e4 req-8737ec85-b4e2-49fd-b34a-a4491ec44bb2 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:30.201543 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-f1be9590-32f2-4f87-88e5-3bc7a4eb02e4 req-8737ec85-b4e2-49fd-b34a-a4491ec44bb2 service nova] Creating event network-vif-plugged:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:45:30.207405 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-f1be9590-32f2-4f87-88e5-3bc7a4eb02e4 req-8737ec85-b4e2-49fd-b34a-a4491ec44bb2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034025 Jul 27 16:45:30.207984 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 529/1035] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:45:30.801320 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:30.801966 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:30.808514 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:30.808989 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:30.809751 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:30.810186 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:30.942396 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:30.950004 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-52163c87-aaf5-4e28-bfe5-1529d0a6634d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1259 microversion: 2.1 time: 0.152608 Jul 27 16:45:30.950563 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 507/1036] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:30 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:31.971562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:31.972300 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:31.978754 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:31.979206 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:31.979967 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:31.980922 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:32.110943 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:32.118548 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8da06951-5212-4bd5-b778-69eb0dba288c tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1443 microversion: 2.1 time: 0.151675 Jul 27 16:45:32.119152 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 530/1037] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:31 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:32.139039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:45:32.139655 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:45:32.146130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:32.146577 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:32.147342 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:32.147777 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:32.283507 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:45:32.294211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-034aaeff-f96a-4bd3-ba4b-6d52c85529ed tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1443 microversion: 2.1 time: 0.158835 Jul 27 16:45:32.294776 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 508/1038] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:45:32 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:45:34.198315 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-ec93cb77-6d68-4e33-b5b9-eeb9e9bfdfaa req-1bf6879b-7cfb-49a6-bc1c-c2b6474e5f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:45:34.208207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-ec93cb77-6d68-4e33-b5b9-eeb9e9bfdfaa req-1bf6879b-7cfb-49a6-bc1c-c2b6474e5f88 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:45:34.208769 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-ec93cb77-6d68-4e33-b5b9-eeb9e9bfdfaa req-1bf6879b-7cfb-49a6-bc1c-c2b6474e5f88 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:45:34.219855 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-ec93cb77-6d68-4e33-b5b9-eeb9e9bfdfaa req-1bf6879b-7cfb-49a6-bc1c-c2b6474e5f88 service nova] Creating event network-changed:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:45:34.225196 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-ec93cb77-6d68-4e33-b5b9-eeb9e9bfdfaa req-1bf6879b-7cfb-49a6-bc1c-c2b6474e5f88 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030746 Jul 27 16:45:34.225987 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 531/1039] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:46:02.704473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:46:02.705089 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Wed Jul 27 16:46:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:46:07.484285 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:07.485471 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:07.487388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:07.488039 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=46 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:07.494177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:07.494626 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:07.495416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:07.495851 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:07.521371 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:46:07.595333 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9777e3aa-cbc1-41a4-9dfb-6a80c1c49489 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "DELETE /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 204 len: 0 microversion: 2.1 time: 0.114756 Jul 27 16:46:07.596044 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 509/1040] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:46:07 2022] DELETE /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:46:07.605680 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:07.606511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:07.608488 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=18 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:07.609199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=34 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:07.615325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:07.615776 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:07.616538 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:07.617078 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:07.803018 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:07.810774 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b280bb95-c59c-448f-8598-26d0147833b1 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1576 microversion: 2.1 time: 0.209458 Jul 27 16:46:07.811326 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 532/1041] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:07 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:08.832772 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:08.833591 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:08.840196 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:08.840636 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:08.841424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:08.841849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:09.018757 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:09.026245 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8f529f16-7321-48ce-9d9f-8d257fc95594 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1576 microversion: 2.1 time: 0.198508 Jul 27 16:46:09.026805 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 510/1042] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:08 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:10.047756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:10.048444 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:10.055850 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:10.056301 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:10.057103 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:10.057533 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:10.126547 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:10.134106 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-014b03a7-4dfb-4978-bbf8-65bb41479fc2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 200 len: 1509 microversion: 2.1 time: 0.090169 Jul 27 16:46:10.139211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 533/1043] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:10 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 1509 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:10.210167 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-671dd217-61cf-4443-ace1-24bdf1262c23 req-8bdf24af-8a85-44a2-a0b6-6202ab361366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478cfc69-4fbf-4a0c-86f4-8de2d02d9283", "name": "network-vif-deleted", "tag": "a559e835-d7c5-4eed-9e20-a6d0ff6dc325"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:46:10.220235 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-671dd217-61cf-4443-ace1-24bdf1262c23 req-8bdf24af-8a85-44a2-a0b6-6202ab361366 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:10.220680 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-671dd217-61cf-4443-ace1-24bdf1262c23 req-8bdf24af-8a85-44a2-a0b6-6202ab361366 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:10.233042 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-671dd217-61cf-4443-ace1-24bdf1262c23 req-8bdf24af-8a85-44a2-a0b6-6202ab361366 service nova] Creating event network-vif-deleted:a559e835-d7c5-4eed-9e20-a6d0ff6dc325 for instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 on hv-cinder-84969 Jul 27 16:46:10.238070 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-671dd217-61cf-4443-ace1-24bdf1262c23 req-8bdf24af-8a85-44a2-a0b6-6202ab361366 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031885 Jul 27 16:46:10.238669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 511/1044] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:46:11.155904 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:11.156524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:11.163615 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:11.164062 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:11.164829 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:11.165282 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:11.179765 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] HTTP exception thrown: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Request method failure captured: Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 HTTP/1.1 Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wsnzj8C9V4Y5GJ0dp3PGobNgbnRUTcEAWMxjdbJUAEs-O1ifXMzZw4M79xn6spfaqTSieq8qQkF7Hgt89b_d6ekWgCvbVE5jhm4AVjzU-PNO-rZ6qddI9YFUY1m7B2IDvXOqnGzlogGpZwGotEoLSUyWBcCl0GDMibilxWEsHgbiCU Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:46:11.181578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: f965c9163ebf41a9866af7389feaf17c Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:46:11.183793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '478cfc69-4fbf-4a0c-86f4-8de2d02d9283'} Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:46:11.185501 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:46:11.186964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:46:11.189603 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Returning 404 to user: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:46:11.189603 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bdf2be09-b911-4ca0-9d8b-0db4de640e01 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 404 len: 111 microversion: 2.1 time: 0.031241 Jul 27 16:46:11.190180 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 534/1045] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:11 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:46:11.295669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2142724116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-84197481", "security_groups": [{"name": "tempest-secgroup-smoke-773411907"}], "block_device_mapping_v2": [{"uuid": "6056e1cb-b6be-492a-8d0a-a424e2b9095f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f56948a9-265f-4da0-9590-a0bad1ef68c4"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:46:11.407672 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] validate_networks() for [('f56948a9-265f-4da0-9590-a0bad1ef68c4', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:46:11.788229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:46:11.788662 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:46:11.789180 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:46:11.789597 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:46:11.790009 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:46:11.799329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:11.799800 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:11.800583 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:11.801375 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:11.824013 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:46:11.829075 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for user f965c9163ebf41a9866af7389feaf17c and project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:46:11.892478 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:46:11.894690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6056e1cb-b6be-492a-8d0a-a424e2b9095f',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:46:12.024958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-97cef0c9-84c1-438c-b803-243eb2690c11 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733974 Jul 27 16:46:12.025596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 512/1046] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:46:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:46:12.037014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ca9e02aa-41ac-4fea-a883-fa28681321ed tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:12.037707 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ca9e02aa-41ac-4fea-a883-fa28681321ed tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:12.090352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ca9e02aa-41ac-4fea-a883-fa28681321ed tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:12.098937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ca9e02aa-41ac-4fea-a883-fa28681321ed tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1093 microversion: 2.1 time: 0.065299 Jul 27 16:46:12.099521 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 535/1047] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:12 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:13.119859 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:13.121259 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:13.127644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:13.128125 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:13.128922 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:13.129363 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:13.191511 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:13.199789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-19539d31-7a14-4c91-bd0b-9201b9d17572 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1209 microversion: 2.1 time: 0.084280 Jul 27 16:46:13.200388 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 513/1048] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:13 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:14.221801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:14.223124 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:14.231014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:14.231452 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:14.232401 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:14.232833 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:14.274406 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-11678b4c-15ad-4435-8412-85c1e2637586 req-0ac372b4-96c5-4c5f-a895-f90e6b74e65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d067a2-10f4-4da2-86bb-405981d7afbf", "tag": "3f1a1da0-d2e8-43f5-b677-4367ca8c57bd"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:46:14.287024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-11678b4c-15ad-4435-8412-85c1e2637586 req-0ac372b4-96c5-4c5f-a895-f90e6b74e65b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:14.287478 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-11678b4c-15ad-4435-8412-85c1e2637586 req-0ac372b4-96c5-4c5f-a895-f90e6b74e65b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:14.308921 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-11678b4c-15ad-4435-8412-85c1e2637586 req-0ac372b4-96c5-4c5f-a895-f90e6b74e65b service nova] Creating event network-changed:3f1a1da0-d2e8-43f5-b677-4367ca8c57bd for instance c9d067a2-10f4-4da2-86bb-405981d7afbf on hv-cinder-84969 Jul 27 16:46:14.322326 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-11678b4c-15ad-4435-8412-85c1e2637586 req-0ac372b4-96c5-4c5f-a895-f90e6b74e65b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052123 Jul 27 16:46:14.328328 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 514/1049] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:46:14.406211 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:14.414527 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-79fe298c-1aaf-46b0-983a-e1394b6bc9ea tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.197212 Jul 27 16:46:14.415108 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 536/1050] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:14 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:15.437078 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:15.438279 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:15.444400 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:15.444877 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:15.445688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:15.446124 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:15.587993 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:15.595458 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-395b771c-1348-461c-ab61-7b6ab15674f8 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.163112 Jul 27 16:46:15.596019 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 515/1051] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:15 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:16.616551 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:16.617198 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:16.623719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:16.624167 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:16.624946 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:16.625996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:16.755771 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:16.763324 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c5e541d3-38c8-47ee-9ef6-e60862e12549 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.150619 Jul 27 16:46:16.763888 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 537/1052] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:16 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:17.784291 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:17.784992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:17.791492 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:17.791931 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:17.792687 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:17.793208 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:17.924940 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:17.932373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-29fb1a74-8cfe-4756-9592-89930e048a8b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.152077 Jul 27 16:46:17.932942 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 516/1053] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:17 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:18.953870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:18.954646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:18.961040 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:18.961492 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:18.962292 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:18.962729 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:19.092176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:19.100039 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-6f0852b6-acfe-48e3-a7c2-70a65b05004e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.150620 Jul 27 16:46:19.100601 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 538/1054] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:18 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:20.119616 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:20.120234 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:20.126864 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:20.127318 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:20.128087 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:20.128526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:20.261417 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:20.272341 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d46ae52b-6480-4c21-a298-480d38d689f2 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.156594 Jul 27 16:46:20.272916 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 517/1055] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:20 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:21.293750 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:21.294363 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:21.301592 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:21.302035 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:21.302794 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:21.303228 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:21.429552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:21.436940 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-59675888-02d2-4d3b-b7c1-91ab8525f7a4 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.147069 Jul 27 16:46:21.437494 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 539/1056] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:21 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:22.457273 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:22.457892 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:22.460548 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:22.461236 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:22.467495 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:22.467946 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:22.468713 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:22.469207 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:22.602474 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:22.610450 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3ef87f84-29c6-471e-9b39-1a5ee0275a08 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.157132 Jul 27 16:46:22.611012 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 518/1057] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:22 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:23.631617 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:23.632259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:23.634121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:23.640086 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:23.640531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:23.641954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:23.642387 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:23.771562 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:23.778964 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-587c71a4-df30-497e-a276-2c46a438d44e tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.151215 Jul 27 16:46:23.779519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 540/1058] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:23 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:24.348045 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-8ae38904-f5a8-42ff-9f30-fbcbb67b4a6b req-0b1dd6cc-640b-4cf2-a1a5-af7fe34bc53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d067a2-10f4-4da2-86bb-405981d7afbf", "name": "network-vif-plugged", "status": "completed", "tag": "3f1a1da0-d2e8-43f5-b677-4367ca8c57bd"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:46:24.358544 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-8ae38904-f5a8-42ff-9f30-fbcbb67b4a6b req-0b1dd6cc-640b-4cf2-a1a5-af7fe34bc53d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:24.358998 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-8ae38904-f5a8-42ff-9f30-fbcbb67b4a6b req-0b1dd6cc-640b-4cf2-a1a5-af7fe34bc53d service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:24.370615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-8ae38904-f5a8-42ff-9f30-fbcbb67b4a6b req-0b1dd6cc-640b-4cf2-a1a5-af7fe34bc53d service nova] Creating event network-vif-plugged:3f1a1da0-d2e8-43f5-b677-4367ca8c57bd for instance c9d067a2-10f4-4da2-86bb-405981d7afbf on hv-cinder-84969 Jul 27 16:46:24.375510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-8ae38904-f5a8-42ff-9f30-fbcbb67b4a6b req-0b1dd6cc-640b-4cf2-a1a5-af7fe34bc53d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031660 Jul 27 16:46:24.376086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 519/1059] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:46:24.799288 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:24.799895 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:24.806458 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:24.806899 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:24.807646 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:24.808074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:24.939552 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:24.947011 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5c975b63-e298-47da-9310-a1661c3d3bc6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1264 microversion: 2.1 time: 0.151588 Jul 27 16:46:24.947572 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 541/1060] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:24 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:25.968613 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:25.970085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:25.978586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:25.979036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:25.979807 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:25.980247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:26.111615 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:26.119233 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-d585838e-f5ee-4bfe-ae80-1962088af75d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1451 microversion: 2.1 time: 0.155390 Jul 27 16:46:26.119795 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 520/1061] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:25 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:26.139451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:46:26.140064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:46:26.146559 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:26.147001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:26.147757 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:26.148192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:26.276693 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:46:26.284141 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-9a0e9805-71d8-441f-bf7e-49cd267f7637 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1451 microversion: 2.1 time: 0.148660 Jul 27 16:46:26.284697 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 542/1062] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:46:26 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:46:27.929156 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-13760679-bec1-4d48-9ee1-90898b0dda3a req-54ad22f0-c7c4-4563-a60a-dec835496862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d067a2-10f4-4da2-86bb-405981d7afbf", "tag": "3f1a1da0-d2e8-43f5-b677-4367ca8c57bd"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:46:27.938782 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-13760679-bec1-4d48-9ee1-90898b0dda3a req-54ad22f0-c7c4-4563-a60a-dec835496862 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:46:27.939240 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-13760679-bec1-4d48-9ee1-90898b0dda3a req-54ad22f0-c7c4-4563-a60a-dec835496862 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:46:27.950345 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-13760679-bec1-4d48-9ee1-90898b0dda3a req-54ad22f0-c7c4-4563-a60a-dec835496862 service nova] Creating event network-changed:3f1a1da0-d2e8-43f5-b677-4367ca8c57bd for instance c9d067a2-10f4-4da2-86bb-405981d7afbf on hv-cinder-84969 Jul 27 16:46:27.955905 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-13760679-bec1-4d48-9ee1-90898b0dda3a req-54ad22f0-c7c4-4563-a60a-dec835496862 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088516 Jul 27 16:46:27.956749 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 521/1063] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:47:29.564438 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=24 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:47:29.565238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=56 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:47:29.569192 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:47:29.569720 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:29.576344 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:29.576785 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:29.577567 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:29.578008 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:29.600343 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lazy-loading 'flavor' on Instance uuid ee8e8bef-1da8-4935-856c-cc46da8722f9 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:47:29.670655 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2cd68a44-25f8-49a9-ad23-3b6cafdf909f tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "POST /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9/action" status: 202 len: 0 microversion: 2.1 time: 0.107698 Jul 27 16:47:29.671224 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 543/1064] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:47:29 2022] POST /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:47:29.679024 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:47:29.679766 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:47:29.685121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:29.686852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:29.699085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:29.699541 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:29.700345 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:29.700804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:29.843189 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:29.851315 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7c8da5c0-8d14-4200-ae63-07c95df5ca60 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.174407 Jul 27 16:47:29.851868 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 522/1065] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:29 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:30.873014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:30.873715 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:30.880368 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:30.880812 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:30.881591 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:30.882024 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:31.010600 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:31.018556 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-50296117-aee3-4529-8d10-470cae50a4f7 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.149777 Jul 27 16:47:31.019117 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 544/1066] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:30 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:32.039427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:32.040041 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:32.047382 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:32.047823 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:32.048578 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:32.049045 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:32.187117 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:32.194857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-ea45267d-0d25-483f-acf1-589e8879e9ca tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.159348 Jul 27 16:47:32.195428 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 523/1067] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:32 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:33.216035 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:33.216654 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:33.223445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:33.223888 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:33.224641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:33.225107 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:33.352559 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:33.360683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-4da801c3-7f5b-400d-bb0c-3f03f278c0a3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.149017 Jul 27 16:47:33.361269 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 545/1068] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:33 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:34.381734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:34.382361 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:34.388849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:34.389329 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:34.390091 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:34.390521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:34.518963 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:34.526448 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1db40ca9-2318-44b5-94cc-394bb7299d44 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.148679 Jul 27 16:47:34.527010 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 524/1069] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:34 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:35.548267 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:35.548937 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:35.555427 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:35.555872 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:35.556632 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:35.557097 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:35.687098 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:35.694417 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-70ff9d8f-dc47-4550-abb1-4ba811c22202 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.150187 Jul 27 16:47:35.694979 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 546/1070] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:35 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:36.715192 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:36.716423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:36.723536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:36.723989 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:36.724791 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:36.725262 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:36.858130 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:36.865644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2cffe967-2f0b-4a96-a857-b41feaca3869 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.154382 Jul 27 16:47:36.866211 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 525/1071] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:36 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:37.886535 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:37.887742 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:37.894207 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:37.894653 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:37.895402 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:37.895846 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:38.031238 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:38.039623 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-bc863acd-74fb-4a5f-b183-a00ac9e7643d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.156962 Jul 27 16:47:38.040194 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 547/1072] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:37 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:39.062896 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:39.063452 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:39.070184 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:39.070637 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:39.071411 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:39.071849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:39.199461 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:39.206962 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-61abc1fa-fd34-4cb9-82fc-c4412210c64b tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.148721 Jul 27 16:47:39.207520 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 526/1073] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:39 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:40.228160 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:40.228783 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:40.235447 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:40.235927 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:40.236694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:40.237166 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:40.366999 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:40.375161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-02045e77-f6e1-4613-b7aa-9140489d4076 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.150855 Jul 27 16:47:40.375723 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 548/1074] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:40 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:41.398582 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:41.399603 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:41.406760 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:41.407209 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:41.407982 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:41.408416 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:41.810351 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:41.818739 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-4dca3298-61b2-4746-b834-f73170b04014 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.426300 Jul 27 16:47:41.819542 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 527/1075] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:41 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:42.839651 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:42.841001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:42.850786 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:42.851234 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:42.851993 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:42.852426 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:42.980044 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:42.987477 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ded6122a-2033-45e3-bf83-328431acb5c4 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1509 microversion: 2.1 time: 0.151917 Jul 27 16:47:42.988032 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 549/1076] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:42 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:43.008110 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:47:43.008849 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:43.016030 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:43.016525 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:43.017266 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:43.017702 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:43.062047 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124235) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 16:47:43.129079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c0a43e3c-e94d-44fe-b25b-1e48cca4ea70 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "POST /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9/action" status: 202 len: 0 microversion: 2.1 time: 0.124755 Jul 27 16:47:43.129826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 528/1077] 10.222.0.74 () {60 vars in 1278 bytes} [Wed Jul 27 16:47:43 2022] POST /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:47:43.138402 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:43.139051 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:43.145053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:43.145503 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:43.146272 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:43.147053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:43.287978 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:43.295991 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-7571e450-5578-4656-b85a-0a6c76633fbc tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1517 microversion: 2.1 time: 0.162044 Jul 27 16:47:43.296632 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 550/1078] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:43 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:44.316609 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:44.317911 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:44.325121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:44.325574 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:44.326346 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:44.326779 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:44.462006 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:44.469560 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2af2f1ce-f1c1-416f-9a4b-7562bbd58550 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1519 microversion: 2.1 time: 0.156824 Jul 27 16:47:44.470129 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 529/1079] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:44 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:45.491193 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:45.491843 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:45.498304 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:45.498756 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:45.499519 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:45.499954 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:45.629935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:45.638074 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-633b86f6-415a-493b-9b7c-0674160b3f99 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1575 microversion: 2.1 time: 0.150818 Jul 27 16:47:45.638641 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 551/1080] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:45 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:46.502467 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-318c7df0-9f65-43bd-878c-85e73a3473e3 req-d28a34ef-cf1c-40d6-8bde-facf2cdb45c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "name": "network-vif-unplugged", "status": "completed", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:47:46.512192 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-318c7df0-9f65-43bd-878c-85e73a3473e3 req-d28a34ef-cf1c-40d6-8bde-facf2cdb45c3 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:46.512708 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-318c7df0-9f65-43bd-878c-85e73a3473e3 req-d28a34ef-cf1c-40d6-8bde-facf2cdb45c3 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:46.523838 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-318c7df0-9f65-43bd-878c-85e73a3473e3 req-d28a34ef-cf1c-40d6-8bde-facf2cdb45c3 service nova] Creating event network-vif-unplugged:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:47:46.528789 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-318c7df0-9f65-43bd-878c-85e73a3473e3 req-d28a34ef-cf1c-40d6-8bde-facf2cdb45c3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083626 Jul 27 16:47:46.529423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 530/1081] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:47:46.659291 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:46.659907 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:46.666365 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:46.666811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:46.667574 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:46.668009 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:46.795466 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:46.803539 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-5f9d635e-b5ea-4e51-8152-c6f4d7b1daff tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1575 microversion: 2.1 time: 0.148197 Jul 27 16:47:46.804308 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 552/1082] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:46 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:47.826956 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:47.827681 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:47.833978 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:47.834418 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:47.835232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:47.835661 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:47.966926 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:47.974596 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-5924abb4-b66d-4da3-b34d-4e78c41cbb3a tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1575 microversion: 2.1 time: 0.152834 Jul 27 16:47:47.975157 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 531/1083] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:47 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:48.995296 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:48.995914 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:49.002471 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:49.002916 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:49.003665 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:49.004242 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:49.132996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:49.140504 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fcb1fc8c-e9c1-4b67-bc50-0df28c4d2cce tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1575 microversion: 2.1 time: 0.149081 Jul 27 16:47:49.141086 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 553/1084] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:48 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:50.162691 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:50.163346 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:50.171414 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:50.171944 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:50.172727 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:50.173200 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:50.305055 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:50.312641 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-8bafb74c-d7a0-4ddc-bc4d-e52c853dfd32 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1575 microversion: 2.1 time: 0.154464 Jul 27 16:47:50.313246 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 532/1085] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:50 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:51.333633 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:51.334237 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:51.341241 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:51.341683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:51.342430 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:51.342863 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:51.473781 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:51.482176 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-36c92052-3501-4f39-96be-465f4934dac1 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1575 microversion: 2.1 time: 0.152359 Jul 27 16:47:51.482737 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 554/1086] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:51 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:47:52.503247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:47:52.503857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:47:52.510413 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:52.510855 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:52.511638 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:52.512067 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:52.641231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:47:52.648906 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-174d63da-3e04-4120-8223-f1432a9b3496 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1562 microversion: 2.1 time: 0.149580 Jul 27 16:47:52.649473 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 533/1087] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:47:52 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:47:54.571899 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:47:54.572353 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Wed Jul 27 16:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:47:58.019472 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-d3a1ed82-2055-4eeb-9a88-a1f7ec2b1396 req-0535782e-8904-4826-8e96-92cf743dd4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "name": "network-vif-plugged", "status": "completed", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:47:58.030977 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-d3a1ed82-2055-4eeb-9a88-a1f7ec2b1396 req-0535782e-8904-4826-8e96-92cf743dd4d8 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:47:58.032184 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-d3a1ed82-2055-4eeb-9a88-a1f7ec2b1396 req-0535782e-8904-4826-8e96-92cf743dd4d8 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:47:58.043905 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-d3a1ed82-2055-4eeb-9a88-a1f7ec2b1396 req-0535782e-8904-4826-8e96-92cf743dd4d8 service nova] Creating event network-vif-plugged:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:47:58.050244 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-d3a1ed82-2055-4eeb-9a88-a1f7ec2b1396 req-0535782e-8904-4826-8e96-92cf743dd4d8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Jul 27 16:47:58.050900 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 555/1088] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:48:01.809306 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-55073665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-84197481", "security_groups": [{"name": "tempest-secgroup-smoke-773411907"}], "block_device_mapping_v2": [{"uuid": "6bad985a-853e-49b9-b311-1079eb7226a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f56948a9-265f-4da0-9590-a0bad1ef68c4"}]}} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:48:01.819309 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:01.925462 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.network.neutron [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] validate_networks() for [('f56948a9-265f-4da0-9590-a0bad1ef68c4', None, None, None, None, None)] {{(pid=124235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 16:48:02.293868 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Flavor limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 16:48:02.294318 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Image limits 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 16:48:02.294796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Flavor pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 16:48:02.295210 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Image pref 0:0:0 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 16:48:02.295624 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.virt.hardware [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 16:48:02.304479 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:02.304960 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:02.305770 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:02.306214 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:02.312832 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:02.326752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 16:48:02.330753 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.quota [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Getting quotas for user f965c9163ebf41a9866af7389feaf17c and project c24a78af0a5d46de89b42a548fc3f43c. Resources: {'instances', 'ram', 'cores'} {{(pid=124235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 16:48:02.387170 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Going to run 1 instances... {{(pid=124235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 16:48:02.389284 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bad985a-853e-49b9-b311-1079eb7226a7',volume_size=None,volume_type=None)] {{(pid=124235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 16:48:02.513014 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f617e912-a441-4d64-baab-35049b135334 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.707849 Jul 27 16:48:02.513648 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 534/1089] 10.222.0.74 () {60 vars in 1147 bytes} [Wed Jul 27 16:48:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 16:48:02.524864 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-817ac6a1-100d-4c6c-b274-0568b5be87c6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:02.525670 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-817ac6a1-100d-4c6c-b274-0568b5be87c6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:02.529736 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=27 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:02.584190 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-817ac6a1-100d-4c6c-b274-0568b5be87c6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:02.591094 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-817ac6a1-100d-4c6c-b274-0568b5be87c6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1091 microversion: 2.1 time: 0.070473 Jul 27 16:48:02.591741 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 556/1090] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:02 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1091 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:03.612159 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:03.612779 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:03.618972 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:03.619427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:03.620201 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:03.620644 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:03.683883 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:03.691780 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-1c8184b7-42bb-410b-b344-700c6a08c5a7 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1207 microversion: 2.1 time: 0.083996 Jul 27 16:48:03.704937 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 535/1091] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:03 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1207 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:04.713386 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:04.714000 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:04.721451 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:04.721892 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:04.722649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:04.723079 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:04.727035 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:04.768373 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c55bfbc1-e66a-45c6-9de9-18cb78f8fb85 req-44e468bf-421e-49a7-b227-f6bca2d3e162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e8fe7-1ae7-4435-be67-f8eb0a12c287", "tag": "ac498a72-02d2-4701-9463-579a6c9ac491"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:48:04.792405 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c55bfbc1-e66a-45c6-9de9-18cb78f8fb85 req-44e468bf-421e-49a7-b227-f6bca2d3e162 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:04.793081 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c55bfbc1-e66a-45c6-9de9-18cb78f8fb85 req-44e468bf-421e-49a7-b227-f6bca2d3e162 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:04.809940 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c55bfbc1-e66a-45c6-9de9-18cb78f8fb85 req-44e468bf-421e-49a7-b227-f6bca2d3e162 service nova] Creating event network-changed:ac498a72-02d2-4701-9463-579a6c9ac491 for instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 on hv-cinder-84969 Jul 27 16:48:04.815642 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c55bfbc1-e66a-45c6-9de9-18cb78f8fb85 req-44e468bf-421e-49a7-b227-f6bca2d3e162 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056351 Jul 27 16:48:04.816745 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 536/1092] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:48:04.898730 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:04.907589 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b20fe9ef-4f9b-4e65-820d-30cab49ae851 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.197834 Jul 27 16:48:04.908431 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 557/1093] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:04 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:05.930467 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:05.931173 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:05.938470 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:05.938920 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:05.939695 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:05.940127 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:06.077991 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:06.085419 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-92edac9d-07dd-41d2-8239-012a3c96ff9d tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.159636 Jul 27 16:48:06.085985 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 537/1094] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:05 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:07.106148 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:07.106716 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:07.113155 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:07.113598 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:07.114357 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:07.114793 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:07.245573 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:07.252857 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-8633ab04-0bd8-460d-bcd3-c811a6b90fe3 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.151297 Jul 27 16:48:07.253422 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 558/1095] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:07 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:08.273958 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:08.274575 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:08.283990 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:08.284427 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:08.285260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:08.285690 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:08.417539 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:08.425092 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-70ca4abe-43af-4604-a1c5-988147c96e60 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.154977 Jul 27 16:48:08.425584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 538/1096] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:08 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:09.446244 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:09.446799 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:09.453873 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:09.454316 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:09.455085 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:09.455503 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:09.583930 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:09.591323 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fd3c7fa3-8cb7-4615-91bd-32e4e2154b12 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.149023 Jul 27 16:48:09.591874 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 559/1097] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:09 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:10.612424 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:10.613080 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:10.619584 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:10.620035 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:10.620800 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:10.621260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:10.753308 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:10.761518 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-721c12b3-44e5-4c37-8eca-0a9f4bc2d055 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.152961 Jul 27 16:48:10.762081 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 539/1098] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:10 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:11.781770 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:11.782361 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:11.788596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:11.789067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:11.789820 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:11.790246 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:11.917590 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:11.925163 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-48bfa47f-be6c-4ac0-b342-6c9af639f716 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.147182 Jul 27 16:48:11.925719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 560/1099] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:11 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:12.946084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:12.946683 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:12.949400 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=2 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:12.950079 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell0:SELECT=6 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:12.955792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:12.956231 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:12.957017 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:12.957446 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:13.088500 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:13.096166 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-f74b74c6-a0db-43a1-8098-27e1dd9def06 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.153998 Jul 27 16:48:13.096740 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 540/1100] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:12 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:14.116543 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:14.117190 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:14.119067 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell0:SELECT=2 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:14.124999 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:14.125445 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:14.126204 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:14.126637 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:14.263970 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:14.271380 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-1be48f5c-e8de-4611-921b-25bdb34ce205 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.158780 Jul 27 16:48:14.271933 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 561/1101] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:14 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:48:15.292463 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:15.293734 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:15.300322 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:15.300763 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:15.301560 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:15.301992 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:15.431123 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:15.439928 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-c085db5d-52c4-49f5-b6e3-fb19373b83ae tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.151326 Jul 27 16:48:15.440660 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 541/1102] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:15 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:16.097865 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-14fabcc1-6091-4c9f-aed7-70a691d0f6d1 req-de59ea20-593e-4659-99fe-d3799fde380c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e8fe7-1ae7-4435-be67-f8eb0a12c287", "name": "network-vif-plugged", "status": "completed", "tag": "ac498a72-02d2-4701-9463-579a6c9ac491"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:48:16.108412 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-14fabcc1-6091-4c9f-aed7-70a691d0f6d1 req-de59ea20-593e-4659-99fe-d3799fde380c service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:16.109223 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-14fabcc1-6091-4c9f-aed7-70a691d0f6d1 req-de59ea20-593e-4659-99fe-d3799fde380c service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:16.122064 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-14fabcc1-6091-4c9f-aed7-70a691d0f6d1 req-de59ea20-593e-4659-99fe-d3799fde380c service nova] Creating event network-vif-plugged:ac498a72-02d2-4701-9463-579a6c9ac491 for instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 on hv-cinder-84969 Jul 27 16:48:16.126918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-14fabcc1-6091-4c9f-aed7-70a691d0f6d1 req-de59ea20-593e-4659-99fe-d3799fde380c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Jul 27 16:48:16.127496 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 562/1103] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:48:16.461852 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:16.462472 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:16.470137 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:16.470594 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:16.471499 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:16.471804 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:16.607521 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:16.615022 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-86b2c4e1-430e-4344-a13e-480125d57e48 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1262 microversion: 2.1 time: 0.157112 Jul 27 16:48:16.615606 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 542/1104] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:16 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:17.273014 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:48:17.273482 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Wed Jul 27 16:48:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:48:17.638079 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:17.638699 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:17.644861 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:17.645336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:17.646133 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:17.646649 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:17.775325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:17.783161 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ecadebff-85aa-41a8-a371-fa84d73094a9 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1449 microversion: 2.1 time: 0.150851 Jul 27 16:48:17.783717 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 563/1105] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:17 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:17.803423 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:48:17.804043 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:48:17.811073 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:17.811526 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:17.812290 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:17.812731 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:17.949943 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:48:17.957519 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-cc2a8493-7d64-4592-ab37-daf8cec5a1cd tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1449 microversion: 2.1 time: 0.157897 Jul 27 16:48:17.958068 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 543/1106] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:48:17 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:48:19.590578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-324156b2-4b65-4f43-a1ad-b9bd16885c10 req-952571e3-7ca3-42b0-9363-eea95ebe3657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e8fe7-1ae7-4435-be67-f8eb0a12c287", "tag": "ac498a72-02d2-4701-9463-579a6c9ac491"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:48:19.600251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-324156b2-4b65-4f43-a1ad-b9bd16885c10 req-952571e3-7ca3-42b0-9363-eea95ebe3657 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:48:19.600634 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-324156b2-4b65-4f43-a1ad-b9bd16885c10 req-952571e3-7ca3-42b0-9363-eea95ebe3657 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:48:19.611517 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-324156b2-4b65-4f43-a1ad-b9bd16885c10 req-952571e3-7ca3-42b0-9363-eea95ebe3657 service nova] Creating event network-changed:ac498a72-02d2-4701-9463-579a6c9ac491 for instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 on hv-cinder-84969 Jul 27 16:48:19.616396 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-324156b2-4b65-4f43-a1ad-b9bd16885c10 req-952571e3-7ca3-42b0-9363-eea95ebe3657 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083405 Jul 27 16:48:19.617021 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 564/1107] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:49:06.385325 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=19 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:06.385955 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:06.386321 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:06.386856 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=39 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:06.388485 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:06.389232 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=51 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:06.392044 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-a034628a-5b44-4c01-9415-27bed9ec2541 req-d425d38d-4301-4546-b364-ec6614c67179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:49:06.394857 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:06.395940 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:06.396327 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:06.396791 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:06.403896 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-a034628a-5b44-4c01-9415-27bed9ec2541 req-d425d38d-4301-4546-b364-ec6614c67179 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:06.404381 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-a034628a-5b44-4c01-9415-27bed9ec2541 req-d425d38d-4301-4546-b364-ec6614c67179 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:06.420638 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-a034628a-5b44-4c01-9415-27bed9ec2541 req-d425d38d-4301-4546-b364-ec6614c67179 service nova] Creating event network-changed:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:49:06.425762 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-a034628a-5b44-4c01-9415-27bed9ec2541 req-d425d38d-4301-4546-b364-ec6614c67179 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042031 Jul 27 16:49:06.426548 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 565/1108] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:49:06.427321 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Going to try to terminate instance {{(pid=124235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:49:06.509510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-66a29469-d9b3-46f9-b96c-90aa42dca1c8 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "DELETE /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 204 len: 0 microversion: 2.1 time: 0.128125 Jul 27 16:49:06.510752 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 544/1109] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:49:06 2022] DELETE /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:49:06.521456 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:06.522419 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:06.530075 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:06.530516 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:06.531275 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:06.531702 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:06.668719 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:49:06.676265 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-b52369d2-d008-4897-a454-194e30e9c808 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.160308 Jul 27 16:49:06.676825 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 566/1110] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:49:06 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:49:07.697953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:07.698663 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:07.705340 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:07.705811 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:07.706646 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:07.707086 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:07.837441 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:49:07.845938 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-a1dcd3a6-c292-4950-a446-7ab563f9e1e3 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1568 microversion: 2.1 time: 0.152250 Jul 27 16:49:07.846510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 545/1111] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:49:07 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:49:08.781360 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [req-4f835798-9677-44fa-964e-41bb9e4f3778 req-e25b355a-1887-4bbd-bc8c-bc5ca008392e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8e8bef-1da8-4935-856c-cc46da8722f9", "name": "network-vif-deleted", "tag": "c8f5f3b6-0953-4e49-9715-b6f98fc2a29c"}]} {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:49:08.795459 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-4f835798-9677-44fa-964e-41bb9e4f3778 req-e25b355a-1887-4bbd-bc8c-bc5ca008392e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:08.795903 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [req-4f835798-9677-44fa-964e-41bb9e4f3778 req-e25b355a-1887-4bbd-bc8c-bc5ca008392e service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:08.810555 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.compute.server_external_events [req-4f835798-9677-44fa-964e-41bb9e4f3778 req-e25b355a-1887-4bbd-bc8c-bc5ca008392e service nova] Creating event network-vif-deleted:c8f5f3b6-0953-4e49-9715-b6f98fc2a29c for instance ee8e8bef-1da8-4935-856c-cc46da8722f9 on hv-cinder-84969 Jul 27 16:49:08.815811 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [req-4f835798-9677-44fa-964e-41bb9e4f3778 req-e25b355a-1887-4bbd-bc8c-bc5ca008392e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038724 Jul 27 16:49:08.816795 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 567/1112] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:49:08.867358 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:08.867991 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:08.874453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:08.874904 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:08.875663 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:08.876098 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:08.936522 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cc5606ede347b3894855fed8f49fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a4d6fb95404988996ef7680ac1829e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:49:08.943971 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-2632f0cb-8b2e-4908-99c3-3c1710e6f985 tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 200 len: 1219 microversion: 2.1 time: 0.080525 Jul 27 16:49:08.944581 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 546/1113] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:49:08 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:49:09.966217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:09.966923 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [instance: ee8e8bef-1da8-4935-856c-cc46da8722f9] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:09.973860 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:09.974310 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:09.975073 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:09.975511 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:09.989407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] HTTP exception thrown: Instance ee8e8bef-1da8-4935-856c-cc46da8722f9 could not be found. Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Request method failure captured: Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 HTTP/1.1 Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4WuJl1MmHcXdHFdYyENugCfxr5y7ibXA42Ubgr5HajhwirfHkk4n2rFRorviGGsTyIj3WsKg260AdA3B8Mm1pG5gKukCa6Rb9bSF87MdKovh2BPZsMvClMMSRay8hwcZxnpzexNxNaRfpWonn7I9VtZPsfpWHbUwYpmMx3E3GrfYL6U Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: 51a4d6fb95404988996ef7680ac1829e Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-TestShelveInstance-2110723754 Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:49:09.991001 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/51a4d6fb95404988996ef7680ac1829e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/51a4d6fb95404988996ef7680ac1829e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_51a4d6fb95404988996ef7680ac1829e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/51a4d6fb95404988996ef7680ac1829e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-TestShelveInstance-2110723754 Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: 51a4d6fb95404988996ef7680ac1829e Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-TestShelveInstance-2110723754 Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-TestShelveInstance-2110723754-project Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: a5cc5606ede347b3894855fed8f49fb8 Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-TestShelveInstance-2110723754-project Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance ee8e8bef-1da8-4935-856c-cc46da8722f9 could not be found. Jul 27 16:49:09.992676 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': 'ee8e8bef-1da8-4935-856c-cc46da8722f9'} Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8e8bef-1da8-4935-856c-cc46da8722f9 could not be found. Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:49:09.993696 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8e8bef-1da8-4935-856c-cc46da8722f9 could not be found. Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8e8bef-1da8-4935-856c-cc46da8722f9 could not be found. Jul 27 16:49:09.995336 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:49:09.996767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Returning 404 to user: Instance ee8e8bef-1da8-4935-856c-cc46da8722f9 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:49:09.996767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-25065411-4014-4529-b63e-432442d0980d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9" status: 404 len: 111 microversion: 2.1 time: 0.030858 Jul 27 16:49:09.996767 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 568/1114] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:49:09 2022] GET /compute/v2.1/servers/ee8e8bef-1da8-4935-856c-cc46da8722f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:49:10.157694 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-13a74a4f-d441-4ffa-b1ec-5276492c647d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] Calling method '.version_select at 0x7ff56c77cc10>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:10.162450 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13a74a4f-d441-4ffa-b1ec-5276492c647d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [f55e738b-e8c4-4c65-be2b-beedc20c5fee] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 16:49:11.172565 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [None req-13a74a4f-d441-4ffa-b1ec-5276492c647d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] [f55e738b-e8c4-4c65-be2b-beedc20c5fee] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 42946. Jul 27 16:49:11.192101 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-13a74a4f-d441-4ffa-b1ec-5276492c647d tempest-TestShelveInstance-2110723754 tempest-TestShelveInstance-2110723754-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1575939626" status: 202 len: 0 microversion: 2.1 time: 1.038304 Jul 27 16:49:11.193035 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 547/1115] 10.222.0.74 () {58 vars in 1254 bytes} [Wed Jul 27 16:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1575939626 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:49:59.362121 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:59.362752 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:59.363140 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:59.363384 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG dbcounter [-] [124235] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:59.367974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-1d1bff12-a657-4946-9c08-53e41d1ad71b req-1dd9556f-02dd-4f35-8ccd-5246d0a44996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666e8fe7-1ae7-4435-be67-f8eb0a12c287", "tag": "ac498a72-02d2-4701-9463-579a6c9ac491"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:49:59.368822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_api:SELECT=8 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:59.369625 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG dbcounter [-] [124236] Writing DB stats nova_cell1:SELECT=12 {{(pid=124236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:49:59.371645 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:59.372216 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:59.373121 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:59.373653 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:59.379629 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1d1bff12-a657-4946-9c08-53e41d1ad71b req-1dd9556f-02dd-4f35-8ccd-5246d0a44996 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:59.380077 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-1d1bff12-a657-4946-9c08-53e41d1ad71b req-1dd9556f-02dd-4f35-8ccd-5246d0a44996 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:59.393254 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-1d1bff12-a657-4946-9c08-53e41d1ad71b req-1dd9556f-02dd-4f35-8ccd-5246d0a44996 service nova] Creating event network-changed:ac498a72-02d2-4701-9463-579a6c9ac491 for instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 on hv-cinder-84969 Jul 27 16:49:59.398620 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-1d1bff12-a657-4946-9c08-53e41d1ad71b req-1dd9556f-02dd-4f35-8ccd-5246d0a44996 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037928 Jul 27 16:49:59.399214 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 548/1116] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:49:59.410053 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:49:59.512217 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-ca53e532-fac5-4062-be27-5c40204c0e6f tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "DELETE /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 204 len: 0 microversion: 2.1 time: 0.153474 Jul 27 16:49:59.512870 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 569/1117] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:49:59 2022] DELETE /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:49:59.523152 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:49:59.523999 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:49:59.531721 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:59.532529 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:59.533580 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:49:59.534260 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:49:59.682974 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:49:59.690450 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-3d414dd5-ad13-4b06-945c-6285ba3171c0 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1574 microversion: 2.1 time: 0.171521 Jul 27 16:49:59.691016 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 549/1118] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:49:59 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:50:00.712118 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:00.713347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:00.719959 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:00.720409 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:00.721199 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:00.721636 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:00.901578 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:50:00.909023 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-f539fecc-a863-49e2-b271-fea84bd4f386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1574 microversion: 2.1 time: 0.201190 Jul 27 16:50:00.909577 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 570/1119] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:00 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:50:01.449391 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-5d7c8cc9-11db-426c-be9d-c3db5bc69603 req-954ee74e-9282-4b18-90df-433f79013e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666e8fe7-1ae7-4435-be67-f8eb0a12c287", "name": "network-vif-deleted", "tag": "ac498a72-02d2-4701-9463-579a6c9ac491"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:50:01.465796 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5d7c8cc9-11db-426c-be9d-c3db5bc69603 req-954ee74e-9282-4b18-90df-433f79013e2b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:01.466243 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-5d7c8cc9-11db-426c-be9d-c3db5bc69603 req-954ee74e-9282-4b18-90df-433f79013e2b service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:01.478725 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-5d7c8cc9-11db-426c-be9d-c3db5bc69603 req-954ee74e-9282-4b18-90df-433f79013e2b service nova] Creating event network-vif-deleted:ac498a72-02d2-4701-9463-579a6c9ac491 for instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 on hv-cinder-84969 Jul 27 16:50:01.483669 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-5d7c8cc9-11db-426c-be9d-c3db5bc69603 req-954ee74e-9282-4b18-90df-433f79013e2b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040351 Jul 27 16:50:01.484247 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 550/1120] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 16:50:01.929596 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:01.930279 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:01.937735 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:01.938178 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:01.939142 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:01.939582 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:01.971777 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:01.972259 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:01.972630 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lazy-loading 'fault' on Instance uuid 666e8fe7-1ae7-4435-be67-f8eb0a12c287 {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:50:02.028832 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:50:02.036153 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-e85e920a-2eb3-4c16-bf86-487da4a4097b tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 200 len: 1227 microversion: 2.1 time: 0.110458 Jul 27 16:50:02.037129 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 571/1121] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:01 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 1227 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:50:03.059092 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:03.059784 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 666e8fe7-1ae7-4435-be67-f8eb0a12c287] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:03.066397 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:03.066837 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:03.067600 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:03.068036 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:03.083610 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] HTTP exception thrown: Instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 could not be found. Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Request method failure captured: Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 HTTP/1.1 Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wsnzj8C9V4Y5GJ0dp3PGobNgbnRUTcEAWMxjdbJUAEs-O1ifXMzZw4M79xn6spfaqTSieq8qQkF7Hgt89b_d6ekWgCvbVE5jhm4AVjzU-PNO-rZ6qddI9YFUY1m7B2IDvXOqnGzlogGpZwGotEoLSUyWBcCl0GDMibilxWEsHgbiCU Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:50:03.085237 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: f965c9163ebf41a9866af7389feaf17c Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 could not be found. Jul 27 16:50:03.086953 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '666e8fe7-1ae7-4435-be67-f8eb0a12c287'} Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 could not be found. Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:50:03.088536 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 could not be found. Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 could not be found. Jul 27 16:50:03.090229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:03.091688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Returning 404 to user: Instance 666e8fe7-1ae7-4435-be67-f8eb0a12c287 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:50:03.091688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-51b76806-da78-49aa-8521-d8032188bd39 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287" status: 404 len: 111 microversion: 2.1 time: 0.032491 Jul 27 16:50:03.091688 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 551/1122] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:03 2022] GET /compute/v2.1/servers/666e8fe7-1ae7-4435-be67-f8eb0a12c287 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:50:06.356675 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:06.361930 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-c694d65e-b39d-4b3e-b805-26a08fb0f3dd req-f7d4d584-8b99-4a7a-b777-a604c5e007a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d067a2-10f4-4da2-86bb-405981d7afbf", "tag": "3f1a1da0-d2e8-43f5-b677-4367ca8c57bd"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:50:06.362695 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:06.370113 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:06.370586 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:06.371347 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:06.371996 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:06.372694 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c694d65e-b39d-4b3e-b805-26a08fb0f3dd req-f7d4d584-8b99-4a7a-b777-a604c5e007a3 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:06.373238 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-c694d65e-b39d-4b3e-b805-26a08fb0f3dd req-f7d4d584-8b99-4a7a-b777-a604c5e007a3 service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:06.384950 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-c694d65e-b39d-4b3e-b805-26a08fb0f3dd req-f7d4d584-8b99-4a7a-b777-a604c5e007a3 service nova] Creating event network-changed:3f1a1da0-d2e8-43f5-b677-4367ca8c57bd for instance c9d067a2-10f4-4da2-86bb-405981d7afbf on hv-cinder-84969 Jul 27 16:50:06.390453 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-c694d65e-b39d-4b3e-b805-26a08fb0f3dd req-f7d4d584-8b99-4a7a-b777-a604c5e007a3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032097 Jul 27 16:50:06.391435 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 552/1123] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:50:06.398505 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Going to try to terminate instance {{(pid=124236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 16:50:06.487969 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-fbfc3cfb-2868-462a-8e54-520fea0d7386 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 204 len: 0 microversion: 2.1 time: 0.135165 Jul 27 16:50:06.493337 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 572/1124] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:50:06 2022] DELETE /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 16:50:06.498321 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:06.499124 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:06.506254 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:06.506801 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:06.507633 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:06.508142 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:06.646700 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.policy [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:50:06.654792 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-370f583f-6d50-4d0d-a66b-c0070d7e5f88 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1576 microversion: 2.1 time: 0.160818 Jul 27 16:50:06.655510 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 553/1125] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:06 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 16:50:07.677276 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:07.677973 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:07.684971 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:07.685413 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:07.686159 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:07.686588 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:07.823989 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:50:07.831531 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2250a8ac-f142-4e06-b66f-b9dce8a0e293 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1576 microversion: 2.1 time: 0.158402 Jul 27 16:50:07.832017 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 573/1126] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:07 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:50:08.441699 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [req-7264f215-0291-4041-806b-763302683816 req-e88d68b3-d08d-4c0d-8754-bbf8176e95cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d067a2-10f4-4da2-86bb-405981d7afbf", "name": "network-vif-deleted", "tag": "3f1a1da0-d2e8-43f5-b677-4367ca8c57bd"}]} {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 16:50:08.451647 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7264f215-0291-4041-806b-763302683816 req-e88d68b3-d08d-4c0d-8754-bbf8176e95cf service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:08.452085 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [req-7264f215-0291-4041-806b-763302683816 req-e88d68b3-d08d-4c0d-8754-bbf8176e95cf service nova] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:08.463718 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.compute.server_external_events [req-7264f215-0291-4041-806b-763302683816 req-e88d68b3-d08d-4c0d-8754-bbf8176e95cf service nova] Creating event network-vif-deleted:3f1a1da0-d2e8-43f5-b677-4367ca8c57bd for instance c9d067a2-10f4-4da2-86bb-405981d7afbf on hv-cinder-84969 Jul 27 16:50:08.468673 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [req-7264f215-0291-4041-806b-763302683816 req-e88d68b3-d08d-4c0d-8754-bbf8176e95cf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030826 Jul 27 16:50:08.469281 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 554/1127] 10.222.0.74 () {64 vars in 1317 bytes} [Wed Jul 27 16:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 16:50:08.854801 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:08.855479 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:08.862221 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:08.862661 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:08.863407 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:08.863836 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:08.893079 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:08.893443 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:08.893877 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.objects.instance [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lazy-loading 'fault' on Instance uuid c9d067a2-10f4-4da2-86bb-405981d7afbf {{(pid=124236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 16:50:08.937598 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.policy [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f965c9163ebf41a9866af7389feaf17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24a78af0a5d46de89b42a548fc3f43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 16:50:08.945251 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-c1986c63-5b66-4156-a250-37cd8ecc8b47 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 200 len: 1229 microversion: 2.1 time: 0.095219 Jul 27 16:50:08.945822 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 574/1128] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:08 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 16:50:09.968084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:09.968841 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: c9d067a2-10f4-4da2-86bb-405981d7afbf] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:09.975135 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:09.975586 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:09.976394 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:09.976863 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:09.990481 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] HTTP exception thrown: Instance c9d067a2-10f4-4da2-86bb-405981d7afbf could not be found. Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Request method failure captured: Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf HTTP/1.1 Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wsnzj8C9V4Y5GJ0dp3PGobNgbnRUTcEAWMxjdbJUAEs-O1ifXMzZw4M79xn6spfaqTSieq8qQkF7Hgt89b_d6ekWgCvbVE5jhm4AVjzU-PNO-rZ6qddI9YFUY1m7B2IDvXOqnGzlogGpZwGotEoLSUyWBcCl0GDMibilxWEsHgbiCU Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:50:09.992074 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: f965c9163ebf41a9866af7389feaf17c Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance c9d067a2-10f4-4da2-86bb-405981d7afbf could not be found. Jul 27 16:50:09.994303 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': 'c9d067a2-10f4-4da2-86bb-405981d7afbf'} Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d067a2-10f4-4da2-86bb-405981d7afbf could not be found. Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:50:09.995249 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d067a2-10f4-4da2-86bb-405981d7afbf could not be found. Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d067a2-10f4-4da2-86bb-405981d7afbf could not be found. Jul 27 16:50:09.996762 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:09.998161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Returning 404 to user: Instance c9d067a2-10f4-4da2-86bb-405981d7afbf could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:50:09.998161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-9cdcacc3-1090-4bd0-8db3-7aad8560e5ee tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf" status: 404 len: 111 microversion: 2.1 time: 0.031217 Jul 27 16:50:09.998161 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 555/1129] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:09 2022] GET /compute/v2.1/servers/c9d067a2-10f4-4da2-86bb-405981d7afbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:50:10.440918 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:10.441423 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.compute.api [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:10.448117 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:10.448560 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:10.449383 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:10.449815 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG oslo_concurrency.lockutils [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:10.463356 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.wsgi [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] HTTP exception thrown: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Request method failure captured: Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: request: DELETE /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 HTTP/1.1 Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept: application/json Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Accept-Encoding: identity Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Connection: close Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Length: 0 Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Content-Type: application/json Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Host: 10.222.0.74 Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Openstack-System-Scope: None Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: User-Agent: python-urllib3/1.26.10 Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Auth-Token: gAAAAABi4Wsnzj8C9V4Y5GJ0dp3PGobNgbnRUTcEAWMxjdbJUAEs-O1ifXMzZw4M79xn6spfaqTSieq8qQkF7Hgt89b_d6ekWgCvbVE5jhm4AVjzU-PNO-rZ6qddI9YFUY1m7B2IDvXOqnGzlogGpZwGotEoLSUyWBcCl0GDMibilxWEsHgbiCU Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Id: None Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Domain-Name: None Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Identity-Status: Confirmed Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Is-Admin-Project: True Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Id: default Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Domain-Name: Default Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Project-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Role: reader,member Jul 27 16:50:10.465030 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Roles: reader,member Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-Tenant-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Id: default Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Domain-Name: Default Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Id: f965c9163ebf41a9866af7389feaf17c Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: X-User-Name: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: method: > Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: exception: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.466694 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: action_args: {'id': '478cfc69-4fbf-4a0c-86f4-8de2d02d9283'} Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:50:10.467891 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.469524 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.471173 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Returning 404 to user: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. {{(pid=124236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:50:10.471173 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2de12d81-3a13-4b50-881d-d09ac822a771 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "DELETE /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 404 len: 111 microversion: 2.1 time: 0.029443 Jul 27 16:50:10.471173 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 575/1130] 10.222.0.74 () {58 vars in 1239 bytes} [Wed Jul 27 16:50:10 2022] DELETE /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 16:50:10.475143 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '>' {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:10.475787 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.compute.api [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] [instance: 478cfc69-4fbf-4a0c-86f4-8de2d02d9283] Fetching instance by UUID {{(pid=124235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 16:50:10.482345 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:10.482786 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:10.483840 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 16:50:10.484278 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG oslo_concurrency.lockutils [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Lock "4ee659ef-ec36-43e2-848b-212ef900904c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 16:50:10.497381 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.wsgi [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] HTTP exception thrown: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Request method failure captured: Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: request: GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 HTTP/1.1 Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept: application/json Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Accept-Encoding: identity Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Connection: close Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Length: 0 Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Content-Type: application/json Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Host: 10.222.0.74 Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Openstack-System-Scope: None Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: User-Agent: python-urllib3/1.26.10 Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Auth-Token: gAAAAABi4Wsnzj8C9V4Y5GJ0dp3PGobNgbnRUTcEAWMxjdbJUAEs-O1ifXMzZw4M79xn6spfaqTSieq8qQkF7Hgt89b_d6ekWgCvbVE5jhm4AVjzU-PNO-rZ6qddI9YFUY1m7B2IDvXOqnGzlogGpZwGotEoLSUyWBcCl0GDMibilxWEsHgbiCU Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Id: None Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Domain-Name: None Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Identity-Status: Confirmed Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Is-Admin-Project: True Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Id: default Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Domain-Name: Default Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Project-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Role: reader,member Jul 27 16:50:10.498871 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Roles: reader,member Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c24a78af0a5d46de89b42a548fc3f43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}] Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Id: c24a78af0a5d46de89b42a548fc3f43c Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1996413621 Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Id: default Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Domain-Name: Default Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Id: f965c9163ebf41a9866af7389feaf17c Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: X-User-Name: tempest-TestVolumeBootPattern-1996413621-project Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: method: > Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: exception: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.500625 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: action_args: {'id': '478cfc69-4fbf-4a0c-86f4-8de2d02d9283'} Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: {{(pid=124235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 16:50:10.501622 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. Jul 27 16:50:10.503229 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: ERROR nova.api.openstack.wsgi Jul 27 16:50:10.504649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: DEBUG nova.api.openstack.wsgi [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Returning 404 to user: Instance 478cfc69-4fbf-4a0c-86f4-8de2d02d9283 could not be found. {{(pid=124235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 16:50:10.504649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO nova.api.openstack.requestlog [None req-7d31ce82-a303-4e3a-ac5e-d69f7fd54ee6 tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283" status: 404 len: 111 microversion: 2.1 time: 0.028877 Jul 27 16:50:10.504649 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: [pid: 124235|app: 0|req: 556/1131] 10.222.0.74 () {58 vars in 1236 bytes} [Wed Jul 27 16:50:10 2022] GET /compute/v2.1/servers/478cfc69-4fbf-4a0c-86f4-8de2d02d9283 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 16:50:11.793201 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: DEBUG nova.api.openstack.wsgi [None req-2fc046aa-1a69-4a01-8fc2-49c32d8dd1bf tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] Calling method '.version_select at 0x7ff56cd434c0>' {{(pid=124236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 16:50:11.820249 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO nova.api.openstack.requestlog [None req-2fc046aa-1a69-4a01-8fc2-49c32d8dd1bf tempest-TestVolumeBootPattern-1996413621 tempest-TestVolumeBootPattern-1996413621-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-84197481" status: 202 len: 0 microversion: 2.1 time: 0.031451 Jul 27 16:50:11.820866 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: [pid: 124236|app: 0|req: 576/1132] 10.222.0.74 () {58 vars in 1257 bytes} [Wed Jul 27 16:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-84197481 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 16:50:58.200154 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:50:58.201084 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Wed Jul 27 16:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:51:14.583352 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:51:14.583935 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Wed Jul 27 16:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:52:53.590177 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:52:53.590826 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Wed Jul 27 16:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:53:11.530922 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:53:11.531550 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Wed Jul 27 16:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:53:17.283525 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:53:17.284149 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Wed Jul 27 16:53:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:54:18.210175 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:54:18.210641 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Wed Jul 27 16:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:54:22.717445 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:54:22.718072 dv-cinder-849690-6-iscsi devstack@n-api.service[124235]: Wed Jul 27 16:54:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 16:54:34.591045 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 16:54:34.591683 dv-cinder-849690-6-iscsi devstack@n-api.service[124236]: Wed Jul 27 16:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!